-- Logs begin at Thu 2022-04-28 15:46:31 UTC, end at Thu 2022-04-28 16:55:34 UTC. -- Apr 28 16:18:03.027231 dv-cinder-839760-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 28 16:18:03.035165 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Apr 28 16:18:03 2022] *** Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: nodename: dv-cinder-839760-2-iscsi Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: machine: x86_64 Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: clock source: unix Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: pcre jit disabled Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: detected number of CPU cores: 4 Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: current working directory: / Apr 28 16:18:03.037172 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: detected binary path: /usr/bin/uwsgi-core Apr 28 16:18:03.037838 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: your processes number limit is 47680 Apr 28 16:18:03.037838 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: your memory page size is 4096 bytes Apr 28 16:18:03.037838 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: detected max file descriptor number: 2048 Apr 28 16:18:03.037838 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: lock engine: pthread robust mutexes Apr 28 16:18:03.037838 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: thunder lock: enabled Apr 28 16:18:03.037838 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 28 16:18:03.037838 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 28 16:18:03.084415 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: Python main interpreter initialized at 0x55f418cbb9c0 Apr 28 16:18:03.084415 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: python threads support enabled Apr 28 16:18:03.084415 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: your server socket listen backlog is limited to 100 connections Apr 28 16:18:03.084415 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: your mercy for graceful operations on workers is 90 seconds Apr 28 16:18:03.084772 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: mapped 403077 bytes (393 KB) for 2 cores Apr 28 16:18:03.084871 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: *** Operational MODE: preforking *** Apr 28 16:18:03.085147 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: *** uWSGI is running in multiple interpreter mode *** Apr 28 16:18:03.085147 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: spawned uWSGI master process (pid: 80035) Apr 28 16:18:03.085342 dv-cinder-839760-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 28 16:18:03.086745 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: spawned uWSGI worker 1 (pid: 80048, cores: 1) Apr 28 16:18:03.086745 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: spawned uWSGI worker 2 (pid: 80049, cores: 1) Apr 28 16:18:03.086745 dv-cinder-839760-2-iscsi devstack@keystone.service[80035]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 28 16:18:08.837763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 28 16:18:08.837763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: from cryptography.utils import int_from_bytes Apr 28 16:18:08.838571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 28 16:18:08.838571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: from cryptography.utils import int_from_bytes Apr 28 16:18:08.839389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 28 16:18:08.839389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: from cryptography.utils import int_from_bytes Apr 28 16:18:08.839846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 28 16:18:08.839846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: from cryptography.utils import int_from_bytes Apr 28 16:18:08.888665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 28 16:18:08.888847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 28 16:18:08.889027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 28 16:18:08.889128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] command line args: [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 28 16:18:08.889208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 28 16:18:08.889291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 28 16:18:08.889404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] command line args: [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 28 16:18:08.889483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ================================================================================ {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 28 16:18:08.889676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 28 16:18:08.889755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] admin_token = **** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.889860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ================================================================================ {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 28 16:18:08.889945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] config_dir = [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890198 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] admin_token = **** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] config_source = [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] config_dir = [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] debug = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] config_source = [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.890963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] debug = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891087 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.891960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] list_limit = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] log_config_append = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] list_limit = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] log_config_append = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] log_dir = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892674 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] log_file = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] log_dir = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.892869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] log_file = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.893912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.894002 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.894104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.894180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.894351 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.894482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.894684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.894802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.894913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.895987 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.896109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.896227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.896340 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.896521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.896700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.896823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] publish_errors = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.896888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] publish_errors = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.896947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.897987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] standard_threads = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] standard_threads = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898637 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] use_journal = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.898977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] use_json = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] use_journal = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] use_stderr = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] use_json = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] use_syslog = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] use_stderr = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] use_syslog = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 28 16:18:08.899832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.900974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.901050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.901224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.901302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.901458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.901536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.901698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.901774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.901944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.902021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.902190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.902268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.902429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.902505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.902690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.902777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.902938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.903959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.904135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.904214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.904909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.904994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.905155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.905233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.905391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.905484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.905644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.905728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.905906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.905990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.906159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.906249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.906390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.906467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.906647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.906738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.906883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.906969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.907111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.907188 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.907348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.907426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.907596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.907683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.907829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.907913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.908057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.908140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.908288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.908411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.908535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.908647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.908765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.908938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.909080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.909236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.909405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.909550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.909678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.909818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.909892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.910989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.911900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.912968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.913090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.913167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.913326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.913404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.913563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.913651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.913798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.913934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.914991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.915091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.915218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.915370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.915481 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.915607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.915700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.915773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.915937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916014 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916746 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.916984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.917155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.917233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.917392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.917472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.917625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.917709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.917859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.917944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.918092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.918169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.918336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.918422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.918593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.918676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.918833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.918912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.919070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.919149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.919306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.919384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.919541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.919618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.919773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.919858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.920561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.920650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.920799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.920876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.921058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.921146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.921297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.921382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.921538 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.921616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.921772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.921858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.922978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.923977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.924132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.924217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.924364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.924441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.924609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.924698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.924844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.924976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.925099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.925244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.925464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.925555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.925710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.925788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] auth.external = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.925940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.926017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] auth.external = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.926171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.926258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.926470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.926600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.926730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] auth.password = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.926809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.926961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] auth.password = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.927086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] auth.token = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.927193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] auth.token = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.927310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.927435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.927549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.927669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.927800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.927917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.928035 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.928150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.928286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.928398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.928536 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.928648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.928769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.928881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.929008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] credential.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.929118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] credential.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.929259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.929367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.929794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.929881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.930022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.930130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.930263 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.930370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.930511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.930715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.930795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.930865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.931017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.931096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.931275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.931355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.931517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.931597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.931774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.931853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.932061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.932142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.932312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.932393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.932583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.932662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.932828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.932917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.933086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.933164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.933322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] federation.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.933452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] federation.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.933562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.933642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.933806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.933883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.934054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.934131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.934283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.934363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.934558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.934640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.934793 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.934885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.935047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.935125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.935285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.935363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.935562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.935648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.935802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.935880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.936049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.936126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.936285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.936370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.936532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.936610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.936779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.936856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937248 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.937961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.938039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.938211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.938288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.938462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.938599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.938719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.938788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.938952 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.939031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.939184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.939274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.939426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.939504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.939671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.939748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.939918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.940004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.940174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.940252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.940419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.940496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.940687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.940773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.940926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.941936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.942091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.942180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.942331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.942410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.942598 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.942702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.942847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.942944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.943077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.943156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.943323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.943400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.943568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.943654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.943802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.943880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.944994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.945072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.945230 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.945310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.945468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.945547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.945709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.945790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.945948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.946025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.946185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.946262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.946435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.946520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.946710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.946788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.946942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.947981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.948135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.948212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.948370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.948447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.948599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.948677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.948838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.948915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.949097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.949182 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.949330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.949409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.949577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.949654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.949824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.949900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.950070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.950148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.950303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.950381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.950531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.950633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.950788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.950868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.951022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.951099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.951283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.951360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.951516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.951596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.951762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.951839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.952961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.953990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.954147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.954224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.954390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.954469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.954661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.954742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.954898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.954976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.955152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.955231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.955380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.955457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.955622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.955700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.955857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.955935 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.956090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.956167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.956326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.956403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.956573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.956651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.956813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.956890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.957044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.957121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.957279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.957358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.957518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] resource.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.957594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] resource.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.957767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.957844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.958013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.958092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.958250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.958331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.958499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.958595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.958775 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.958856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959254 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.959964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] role.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.960050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] role.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.960208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] role.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.960286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] role.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.960438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.960515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.960685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.960770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.960933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.961011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.961177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.961254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.961425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.961510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.961670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.961748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.961915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.962000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.962159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.962249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.962406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.962483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.962661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.962742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.962911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.963003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.963158 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.963236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.963402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.963480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.963647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.963733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.964039 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.964117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.964277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.964355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.964526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.964612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.964776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.964853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.965022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.965106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.965269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.965355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.965503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.965581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.965758 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.965835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.966009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.966087 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.966249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.966326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.966478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.966573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.966736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.967304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.967478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.967557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.967730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.967807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.967985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.968064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.968233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.968317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.968468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.968546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.968700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.968780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.968930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] token.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] token.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.969959 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.970135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.970214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.970381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.970458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.970646 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.970730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.970895 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.970976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.971138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.971216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.971386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.971463 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.971623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.971702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.971861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.971938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.972098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.972177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.972344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.972423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.972591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.972668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.972820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.972897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.973062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.973140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.973352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.973429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.973613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.connection = **** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.973698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.connection = **** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.973856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.973938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.974092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.974181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.974329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.974407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.974589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.974669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.974830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.974921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.975067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.975145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.975303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.975380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.975538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.975625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.975782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.975859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.976969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.977987 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 28 16:18:08.978065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 28 16:18:08.978137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 28 16:18:09.009156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.009326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.009406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.009479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.009600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.009684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.018321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.018406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.047897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.048008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.048099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.048175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.101087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.101567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.153501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.153734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.154156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.154980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.219846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.220077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.220241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.220329 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.220477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.220559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.220703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.220785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.220917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.221000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.221131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.221346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.243872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.244994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.245073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.245205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.245293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.245419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.256360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.256638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.271093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.271333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.271543 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.271628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.271763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.271884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.272014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.272094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.272167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.272238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.272383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80049) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.272475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.272593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.272806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80048) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 28 16:18:09.290169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.290379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 28 16:18:09.290461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.290630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 28 16:18:09.290742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.290946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 28 16:18:09.291025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.291161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 28 16:18:09.291253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.291431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.291511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.291689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.291770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.291948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.292035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.292206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.302835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.303112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.303192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.303385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.303466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.303663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.303745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.303948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.312223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.312555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.315549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.315830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.315923 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.316113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.316202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.316394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.316475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.316676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.316756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.316936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.317018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.317206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.317286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.317470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.317549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.317735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.317814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.318001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.318078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.318262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.318348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.318526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.345866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.346320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.347536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.347814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.348003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.348285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.353169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.353413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.353632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.353810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.353892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.354295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.361142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.361420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.361675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.361957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.365904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.366189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.366469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.366660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.366779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.366862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.367056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.367137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.367331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.367421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.367602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.367683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.367871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.367952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.368137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.368404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.386397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.386696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.387130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.387409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.391706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.392458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.395327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.395623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.396122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.396419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.400644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.401543 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.404224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.405685 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.408488 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.408788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.409073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.409355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.409450 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.409632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.409722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.409909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.409992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.410223 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.410504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.410807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.428920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.429203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.429469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.430013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.430147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.430431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.430730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.430998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.437955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.438983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.439695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.439970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.440720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.440998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.443140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.443419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.443698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.443983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.444211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.444293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.444490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.444767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.445043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.445326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.458018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.458297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.458601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.458882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.459160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.459242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.459475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.459554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.459755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.459836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.460036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.460318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.460686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.460984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.478137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.479482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.481418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.482824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.484780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.486160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.486529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.487943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.488196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.488476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.488762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.489585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.489866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.490155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.496045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.497476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.497662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.499653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.501403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.501692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.502084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.502365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.502902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.503192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.503586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.503867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.511523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.511806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.512083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.516011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.516295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.516576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.520535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80049) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.520813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.521090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.521362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.521629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.522868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.523160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.523442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.523733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.524015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.524295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.524547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80048) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 28 16:18:09.524629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.524829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.524910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.525118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80049) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.525207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.525389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.525659 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.526906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.527202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.527493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.527774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.528054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.528335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.528619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.528898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.529171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80048) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 28 16:18:09.563286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f418cbb9c0 pid: 80049 (default app) Apr 28 16:18:09.566644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dfadf-e4e9-442d-b230-6d0e8dbeaac3 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:09.566943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dfadf-e4e9-442d-b230-6d0e8dbeaac3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:09.567234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dfadf-e4e9-442d-b230-6d0e8dbeaac3 None None] PATH_INFO: `/v3` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:09.567596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f418cbb9c0 pid: 80048 (default app) Apr 28 16:18:09.571438 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Thu Apr 28 16:18:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:18.523633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b85be-fd5f-4e8b-af24-3d0f88bdc30f None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:18.524210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b85be-fd5f-4e8b-af24-3d0f88bdc30f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:18.524210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b85be-fd5f-4e8b-af24-3d0f88bdc30f None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:18.528543 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:18.534172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:18.534590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:18.534756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:18.564907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG oslo_db.sqlalchemy.engines [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 28 16:18:18.744814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG passlib.handlers.bcrypt [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80049) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 28 16:18:18.745244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG passlib.handlers.bcrypt [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80049) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 28 16:18:18.801023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:18.802579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:18.928269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 28 16:18:19.099805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b85be-fd5f-4e8b-af24-3d0f88bdc30f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:19.132047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG oslo_db.sqlalchemy.engines [None req-f38b85be-fd5f-4e8b-af24-3d0f88bdc30f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 28 16:18:19.257150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b85be-fd5f-4e8b-af24-3d0f88bdc30f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:19.261471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a36cce-2a23-49aa-b5da-baa9dc7c2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:19.262141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36cce-2a23-49aa-b5da-baa9dc7c2f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:19.262428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36cce-2a23-49aa-b5da-baa9dc7c2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:19.262739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36cce-2a23-49aa-b5da-baa9dc7c2f81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:19.271851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a36cce-2a23-49aa-b5da-baa9dc7c2f81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:19.322612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d2a36cce-2a23-49aa-b5da-baa9dc7c2f81 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 28 16:18:19.322958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a36cce-2a23-49aa-b5da-baa9dc7c2f81 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:19.332839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Apr 28 16:18:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 16:18:19.338727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:19.352757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef846fa-4d92-4706-8d6e-0dbeef2134a0 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:19.357096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48c7c3-e4fd-4615-bdb8-82fb6b728f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:19.358218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c7c3-e4fd-4615-bdb8-82fb6b728f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:19.358505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c7c3-e4fd-4615-bdb8-82fb6b728f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:19.358817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48c7c3-e4fd-4615-bdb8-82fb6b728f78 admin admin] PATH_INFO: `/v3/projects/0143687fa93942b783a5884094e78824` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:19.360321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48c7c3-e4fd-4615-bdb8-82fb6b728f78 admin admin] RBAC: Authorizing `identity:get_project(project_id=0143687fa93942b783a5884094e78824)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:19.410472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ff48c7c3-e4fd-4615-bdb8-82fb6b728f78 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 28 16:18:19.410835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48c7c3-e4fd-4615-bdb8-82fb6b728f78 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:19.415343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Thu Apr 28 16:18:19 2022] GET /identity/v3/projects/0143687fa93942b783a5884094e78824 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:21.624889 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f21c4-bdf2-479e-bc44-88454c7635e5 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:21.625460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f21c4-bdf2-479e-bc44-88454c7635e5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:21.625460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f21c4-bdf2-479e-bc44-88454c7635e5 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:21.629611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:21.634933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c724c05-baae-4ed3-94a2-5b377cd93b11 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:21.635365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c724c05-baae-4ed3-94a2-5b377cd93b11 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:21.635504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c724c05-baae-4ed3-94a2-5b377cd93b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:21.656241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8c724c05-baae-4ed3-94a2-5b377cd93b11 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:21.657775 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8c724c05-baae-4ed3-94a2-5b377cd93b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:21.665678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 28 16:18:21.688390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f21c4-bdf2-479e-bc44-88454c7635e5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:21.700184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f21c4-bdf2-479e-bc44-88454c7635e5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:21.704407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334d13f-0f7b-47aa-b797-fca560965952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:21.705032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d13f-0f7b-47aa-b797-fca560965952 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:21.705318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d13f-0f7b-47aa-b797-fca560965952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:21.705596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d13f-0f7b-47aa-b797-fca560965952 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:21.713165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334d13f-0f7b-47aa-b797-fca560965952 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:21.714981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334d13f-0f7b-47aa-b797-fca560965952 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:21.724048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Apr 28 16:18:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:18:21.729027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c724c05-baae-4ed3-94a2-5b377cd93b11 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:21.738480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c724c05-baae-4ed3-94a2-5b377cd93b11 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:21.743094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bd0a2-8470-49b3-9a80-74b854700a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:21.743952 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd0a2-8470-49b3-9a80-74b854700a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:21.744240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd0a2-8470-49b3-9a80-74b854700a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:21.744519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd0a2-8470-49b3-9a80-74b854700a9a admin admin] PATH_INFO: `/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:21.745915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bd0a2-8470-49b3-9a80-74b854700a9a admin admin] RBAC: Authorizing `identity:get_user(user_id=2df9f80376a24d76bc8b6475e8d5cfc8)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:21.747776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bd0a2-8470-49b3-9a80-74b854700a9a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:21.749339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Thu Apr 28 16:18:21 2022] GET /identity/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:24.057849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084cb6c-1936-4c39-81af-18191fc0ba52 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.058305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084cb6c-1936-4c39-81af-18191fc0ba52 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.058406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084cb6c-1936-4c39-81af-18191fc0ba52 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.059086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf5ef-be3b-45ba-ba05-84c8a41d485f None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.059449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf5ef-be3b-45ba-ba05-84c8a41d485f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.059648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf5ef-be3b-45ba-ba05-84c8a41d485f None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.059955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:24.061525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:24.064930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.065235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.065489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.066620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e81b9-c094-43bc-bfbe-87098a675e8d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.066911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e81b9-c094-43bc-bfbe-87098a675e8d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.067191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e81b9-c094-43bc-bfbe-87098a675e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.106391 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG passlib.handlers.bcrypt [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80048) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 28 16:18:24.106853 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG passlib.handlers.bcrypt [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80048) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 28 16:18:24.154390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:24.156040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:24.193277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-043e81b9-c094-43bc-bfbe-87098a675e8d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:24.195050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-043e81b9-c094-43bc-bfbe-87098a675e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:24.268175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:18:24.277210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:18:24.289575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:24.299948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e81b9-c094-43bc-bfbe-87098a675e8d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:24.384357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6e954-453c-4521-91f9-d50783c8bfc7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:24.394619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e81b9-c094-43bc-bfbe-87098a675e8d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:24.415136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f697d4-029f-4f22-9872-aaf57bdf7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:24.416031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f697d4-029f-4f22-9872-aaf57bdf7b53 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.416319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f697d4-029f-4f22-9872-aaf57bdf7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.416596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f697d4-029f-4f22-9872-aaf57bdf7b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.426653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326202f-b40e-45c8-88a2-4e7a863bdff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:24.427445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326202f-b40e-45c8-88a2-4e7a863bdff3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.427733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326202f-b40e-45c8-88a2-4e7a863bdff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.428009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326202f-b40e-45c8-88a2-4e7a863bdff3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.439640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326202f-b40e-45c8-88a2-4e7a863bdff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:24.446571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-9326202f-b40e-45c8-88a2-4e7a863bdff3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:18:24.447801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 8/14] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:18:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:18:24.453591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326202f-b40e-45c8-88a2-4e7a863bdff3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:24.480081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f697d4-029f-4f22-9872-aaf57bdf7b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:24.481603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f697d4-029f-4f22-9872-aaf57bdf7b53 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:24.547806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326202f-b40e-45c8-88a2-4e7a863bdff3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:24.574406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:24.579407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:24.580070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.580163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f697d4-029f-4f22-9872-aaf57bdf7b53 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:24.580354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.580631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.581390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:24.581702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:24.583148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:24.595926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:24.601695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:24.703917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c1b0c-79b7-4bb4-92b6-8092ca3908c8 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:24.736289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5738317-1ec1-4af5-a63a-24073630de51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:24.737163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5738317-1ec1-4af5-a63a-24073630de51 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.737451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5738317-1ec1-4af5-a63a-24073630de51 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.737729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5738317-1ec1-4af5-a63a-24073630de51 None admin] PATH_INFO: `/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.738976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5738317-1ec1-4af5-a63a-24073630de51 None admin] RBAC: Authorizing `identity:get_user(user_id=2df9f80376a24d76bc8b6475e8d5cfc8)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:24.740431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5738317-1ec1-4af5-a63a-24073630de51 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:24.742046 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 10/17] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:24 2022] GET /identity/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:24.747453 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5738317-1ec1-4af5-a63a-24073630de51 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:24.779991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f697d4-029f-4f22-9872-aaf57bdf7b53 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:24.812439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:24.813234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.813519 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.813795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.831675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:24.833077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:24.840601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5738317-1ec1-4af5-a63a-24073630de51 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:24.849562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:18:24.850790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 8/18] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:18:24.856436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:24.877254 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805891-b9f4-4ed5-9ce3-970b3396d143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:24.878051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805891-b9f4-4ed5-9ce3-970b3396d143 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.878335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805891-b9f4-4ed5-9ce3-970b3396d143 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.878639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805891-b9f4-4ed5-9ce3-970b3396d143 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.879857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805891-b9f4-4ed5-9ce3-970b3396d143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:24.881316 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805891-b9f4-4ed5-9ce3-970b3396d143 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:24.882961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 11/19] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:24.888984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805891-b9f4-4ed5-9ce3-970b3396d143 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:24.951491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd47bb-05f0-4d5c-8f96-f9e6ffae7f7f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:24.983698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6325-c285-489e-a684-a694694a338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:24.984364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6325-c285-489e-a684-a694694a338a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:24.984459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805891-b9f4-4ed5-9ce3-970b3396d143 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:24.984651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6325-c285-489e-a684-a694694a338a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:24.984929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6325-c285-489e-a684-a694694a338a None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:24.985665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6325-c285-489e-a684-a694694a338a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:24.985977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6325-c285-489e-a684-a694694a338a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:24.987386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6325-c285-489e-a684-a694694a338a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:25.003857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 9/20] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:25.016945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecaffc-136e-4664-9761-3cdb7cbeb378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:25.017629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecaffc-136e-4664-9761-3cdb7cbeb378 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:25.017921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecaffc-136e-4664-9761-3cdb7cbeb378 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:25.018204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecaffc-136e-4664-9761-3cdb7cbeb378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:25.019110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecaffc-136e-4664-9761-3cdb7cbeb378 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.domain.id=default, user.id=2df9f80376a24d76bc8b6475e8d5cfc8) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:25.019431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecaffc-136e-4664-9761-3cdb7cbeb378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:25.020945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecaffc-136e-4664-9761-3cdb7cbeb378 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:25.028631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 12/21] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Apr 28 16:18:24 2022] GET /identity/v3/role_assignments?user.id=2df9f80376a24d76bc8b6475e8d5cfc8&scope.domain.id=default&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:27.885336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb785-89d8-4bad-8b6d-71d7bd1bc28c None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:27.886351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb785-89d8-4bad-8b6d-71d7bd1bc28c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:27.886849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb785-89d8-4bad-8b6d-71d7bd1bc28c None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:27.888435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 10/22] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:27.894082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d84c-36c5-4647-b24f-85ec385b5056 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:27.895092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d84c-36c5-4647-b24f-85ec385b5056 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:27.895627 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237d84c-36c5-4647-b24f-85ec385b5056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:27.918409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-2237d84c-36c5-4647-b24f-85ec385b5056 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:27.920496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2237d84c-36c5-4647-b24f-85ec385b5056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:27.930749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d828c06-04e0-4143-af52-792b0d48edaf None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:27.931364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d828c06-04e0-4143-af52-792b0d48edaf None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:27.931848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d828c06-04e0-4143-af52-792b0d48edaf None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:27.933422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 11/23] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:27.939118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27a04-59cc-435e-9c82-0f885153a0a8 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:27.939636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27a04-59cc-435e-9c82-0f885153a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:27.940137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b27a04-59cc-435e-9c82-0f885153a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:27.964191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-54b27a04-59cc-435e-9c82-0f885153a0a8 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:27.965393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-54b27a04-59cc-435e-9c82-0f885153a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:28.000483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 13/24] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:28.002851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042002-9883-4b5c-a9ff-e97a0323b69a None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.003147 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042002-9883-4b5c-a9ff-e97a0323b69a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.003431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042002-9883-4b5c-a9ff-e97a0323b69a None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.006894 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 14/25] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:28.020707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a8bec-1841-422d-b584-65d97f3dd1ca None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.021201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a8bec-1841-422d-b584-65d97f3dd1ca None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.021624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a8bec-1841-422d-b584-65d97f3dd1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.052939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b34a8bec-1841-422d-b584-65d97f3dd1ca None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:28.055587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b34a8bec-1841-422d-b584-65d97f3dd1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:28.079783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 12/26] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 28 16:18:28.082782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b27a04-59cc-435e-9c82-0f885153a0a8 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:28.189235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:28.190389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a8bec-1841-422d-b584-65d97f3dd1ca None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:28.230937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b27a04-59cc-435e-9c82-0f885153a0a8 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:28.278857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:28.286602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.286602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.286602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.298069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:28.299846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:28.325400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a8bec-1841-422d-b584-65d97f3dd1ca None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:28.336761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:18:28.338495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 13/28] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:28.339337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:28.370110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e29c2c-d2fe-4561-afb1-2142f656549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:28.371080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e29c2c-d2fe-4561-afb1-2142f656549d None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.371539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e29c2c-d2fe-4561-afb1-2142f656549d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.371964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e29c2c-d2fe-4561-afb1-2142f656549d None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.372908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e29c2c-d2fe-4561-afb1-2142f656549d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:28.374458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e29c2c-d2fe-4561-afb1-2142f656549d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:28.447964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23606486-373e-4ee3-92dc-ca911becffa5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:28.484078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc61b69-bffa-449a-9ee7-69fc627f8f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:28.484902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61b69-bffa-449a-9ee7-69fc627f8f9b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.485185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61b69-bffa-449a-9ee7-69fc627f8f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.485463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61b69-bffa-449a-9ee7-69fc627f8f9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.499910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc61b69-bffa-449a-9ee7-69fc627f8f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:28.507110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-3fc61b69-bffa-449a-9ee7-69fc627f8f9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:18:28.508416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:28.509277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc61b69-bffa-449a-9ee7-69fc627f8f9b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:28.610741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc61b69-bffa-449a-9ee7-69fc627f8f9b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:28.626047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 16/30] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Apr 28 16:18:28 2022] POST /identity/v3/roles => generated 225 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:28.628270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68a03d-111d-4960-9c3a-191b8640b89e None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.628702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68a03d-111d-4960-9c3a-191b8640b89e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.629014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68a03d-111d-4960-9c3a-191b8640b89e None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.630646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 17/31] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:28.632038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68a03d-111d-4960-9c3a-191b8640b89e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:28.675969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7b4ee-82ff-4935-8b08-ee6cf155fad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:28.676763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b4ee-82ff-4935-8b08-ee6cf155fad5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.677151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b4ee-82ff-4935-8b08-ee6cf155fad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.677513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7b4ee-82ff-4935-8b08-ee6cf155fad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.678348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7b4ee-82ff-4935-8b08-ee6cf155fad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:28.678835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7b4ee-82ff-4935-8b08-ee6cf155fad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:28.680611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7b4ee-82ff-4935-8b08-ee6cf155fad5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:28.695797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 15/32] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:28.697379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c294-b2ca-483c-a0a4-6e058df75302 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.697753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c294-b2ca-483c-a0a4-6e058df75302 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.698172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c294-b2ca-483c-a0a4-6e058df75302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.716249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-efa4c294-b2ca-483c-a0a4-6e058df75302 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:28.719092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-efa4c294-b2ca-483c-a0a4-6e058df75302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:28.786478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68a03d-111d-4960-9c3a-191b8640b89e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:28.799049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 16/33] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:28.800434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455569d-2159-495a-90bc-c041328f27ef None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.800734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455569d-2159-495a-90bc-c041328f27ef None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.801019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455569d-2159-495a-90bc-c041328f27ef None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.802335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 17/34] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:28.807826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455569d-2159-495a-90bc-c041328f27ef None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:28.837699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f70c1-f3f8-42b2-8248-f2e15665e3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:28.838391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f70c1-f3f8-42b2-8248-f2e15665e3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.838789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f70c1-f3f8-42b2-8248-f2e15665e3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.839078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f70c1-f3f8-42b2-8248-f2e15665e3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.839913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f70c1-f3f8-42b2-8248-f2e15665e3b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:28.840233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f70c1-f3f8-42b2-8248-f2e15665e3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:28.842330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f70c1-f3f8-42b2-8248-f2e15665e3b4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:28.852011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 18/35] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:28.853652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a438f7-f2e0-4dd3-b88f-3f93c340b0e1 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.854142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a438f7-f2e0-4dd3-b88f-3f93c340b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.854684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a438f7-f2e0-4dd3-b88f-3f93c340b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.876267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-68a438f7-f2e0-4dd3-b88f-3f93c340b0e1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:28.878120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-68a438f7-f2e0-4dd3-b88f-3f93c340b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:28.929768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455569d-2159-495a-90bc-c041328f27ef None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:28.959406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 19/36] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:28.960240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a438f7-f2e0-4dd3-b88f-3f93c340b0e1 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:28.972919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dcb80-28a0-4c31-91de-5c29f4a9ec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:28.973984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dcb80-28a0-4c31-91de-5c29f4a9ec55 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:28.974829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dcb80-28a0-4c31-91de-5c29f4a9ec55 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:28.975686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dcb80-28a0-4c31-91de-5c29f4a9ec55 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:28.977650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dcb80-28a0-4c31-91de-5c29f4a9ec55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:28.979489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dcb80-28a0-4c31-91de-5c29f4a9ec55 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:29.067055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a438f7-f2e0-4dd3-b88f-3f93c340b0e1 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:29.101051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fba73-41d5-4dca-925e-9d2bef3a7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:29.101734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fba73-41d5-4dca-925e-9d2bef3a7032 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.102027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fba73-41d5-4dca-925e-9d2bef3a7032 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.102311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fba73-41d5-4dca-925e-9d2bef3a7032 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.103106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fba73-41d5-4dca-925e-9d2bef3a7032 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:29.104507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fba73-41d5-4dca-925e-9d2bef3a7032 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:29.167973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 20/37] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Apr 28 16:18:28 2022] POST /identity/v3/roles => generated 219 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:29.174037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fba73-41d5-4dca-925e-9d2bef3a7032 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:29.222474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 18/38] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:18:28 2022] POST /identity/v3/projects => generated 301 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:29.223512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dcb80-28a0-4c31-91de-5c29f4a9ec55 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:29.294617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fba73-41d5-4dca-925e-9d2bef3a7032 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:29.335796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aabf5-83fb-4f71-840b-78c3d0aa1cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:29.336702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aabf5-83fb-4f71-840b-78c3d0aa1cea None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.337036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aabf5-83fb-4f71-840b-78c3d0aa1cea None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.338161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739aabf5-83fb-4f71-840b-78c3d0aa1cea None admin] PATH_INFO: `/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.339516 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739aabf5-83fb-4f71-840b-78c3d0aa1cea None admin] RBAC: Authorizing `identity:get_user(user_id=2df9f80376a24d76bc8b6475e8d5cfc8)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:29.340913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739aabf5-83fb-4f71-840b-78c3d0aa1cea None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:29.342893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 21/39] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:29 2022] GET /identity/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:29.349012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aabf5-83fb-4f71-840b-78c3d0aa1cea None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:29.440233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dcb80-28a0-4c31-91de-5c29f4a9ec55 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:29.466344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739aabf5-83fb-4f71-840b-78c3d0aa1cea None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:29.493288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0d023-0b62-4fef-8299-10c9b06f8145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:29.493905 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d023-0b62-4fef-8299-10c9b06f8145 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.494198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d023-0b62-4fef-8299-10c9b06f8145 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.494490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d023-0b62-4fef-8299-10c9b06f8145 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.495300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0d023-0b62-4fef-8299-10c9b06f8145 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:29.496842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0d023-0b62-4fef-8299-10c9b06f8145 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:29.506138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b009395-53f5-4688-a3c5-34d1a5b40eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:29.507197 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b009395-53f5-4688-a3c5-34d1a5b40eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.507320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b009395-53f5-4688-a3c5-34d1a5b40eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.507557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b009395-53f5-4688-a3c5-34d1a5b40eb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.508979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b009395-53f5-4688-a3c5-34d1a5b40eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:29.510572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b009395-53f5-4688-a3c5-34d1a5b40eb6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:29.512251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 22/40] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:29.513505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe982-2bd3-49e3-bacd-deb0927f135b None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.517028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe982-2bd3-49e3-bacd-deb0927f135b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.517028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe982-2bd3-49e3-bacd-deb0927f135b None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.517028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 23/41] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:29.520029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfe982-2bd3-49e3-bacd-deb0927f135b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:29.557968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 19/42] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Apr 28 16:18:29 2022] POST /identity/v3/roles => generated 223 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:29.559486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dd23d-fac1-4845-a81a-2e4e7df1933e None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.559783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dd23d-fac1-4845-a81a-2e4e7df1933e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.560066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dd23d-fac1-4845-a81a-2e4e7df1933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.583407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-4c5dd23d-fac1-4845-a81a-2e4e7df1933e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:29.585613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4c5dd23d-fac1-4845-a81a-2e4e7df1933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:29.634471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfe982-2bd3-49e3-bacd-deb0927f135b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:29.663270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 20/43] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:29.672568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06682e-e1b2-48b1-8f67-f714768fd0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:29.673874 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06682e-e1b2-48b1-8f67-f714768fd0b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.674346 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06682e-e1b2-48b1-8f67-f714768fd0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.674866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06682e-e1b2-48b1-8f67-f714768fd0b7 None admin] PATH_INFO: `/v3/domains/default/users/2df9f80376a24d76bc8b6475e8d5cfc8/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.677346 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06682e-e1b2-48b1-8f67-f714768fd0b7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2df9f80376a24d76bc8b6475e8d5cfc8, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:29.679484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06682e-e1b2-48b1-8f67-f714768fd0b7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:29.688322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dd23d-fac1-4845-a81a-2e4e7df1933e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:29.752437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 24/44] 10.222.0.43 () {58 vars in 1361 bytes} [Thu Apr 28 16:18:29 2022] PUT /identity/v3/domains/default/users/2df9f80376a24d76bc8b6475e8d5cfc8/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:18:29.792070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dd23d-fac1-4845-a81a-2e4e7df1933e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:29.831060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59e730-8727-482f-af8f-a68fd4971838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:29.831894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59e730-8727-482f-af8f-a68fd4971838 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.832190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59e730-8727-482f-af8f-a68fd4971838 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.832474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59e730-8727-482f-af8f-a68fd4971838 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.833751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59e730-8727-482f-af8f-a68fd4971838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:29.835307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59e730-8727-482f-af8f-a68fd4971838 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:29.837230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 21/45] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:29.843418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06682e-e1b2-48b1-8f67-f714768fd0b7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:29.945637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06682e-e1b2-48b1-8f67-f714768fd0b7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:29.978984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0e3b0-aa6c-4285-a9bc-4fbcac4c1279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:29.979653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0e3b0-aa6c-4285-a9bc-4fbcac4c1279 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:29.979944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0e3b0-aa6c-4285-a9bc-4fbcac4c1279 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:29.980228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0e3b0-aa6c-4285-a9bc-4fbcac4c1279 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:29.980955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0e3b0-aa6c-4285-a9bc-4fbcac4c1279 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:29.982973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0e3b0-aa6c-4285-a9bc-4fbcac4c1279 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:30.069858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 25/46] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:18:29 2022] POST /identity/v3/projects => generated 312 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:31.976663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc2df-d3b1-4a80-b933-bcc1923144f2 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:31.977178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc2df-d3b1-4a80-b933-bcc1923144f2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:31.977284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc2df-d3b1-4a80-b933-bcc1923144f2 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:31.978623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 22/47] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:31.983797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0330c-dd59-409b-99c8-0e3adf84484a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:31.984239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0330c-dd59-409b-99c8-0e3adf84484a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:31.984378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0330c-dd59-409b-99c8-0e3adf84484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.001263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-5af0330c-dd59-409b-99c8-0e3adf84484a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:32.002495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5af0330c-dd59-409b-99c8-0e3adf84484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:32.067923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:32.091160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc2df-d3b1-4a80-b933-bcc1923144f2 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:32.190813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc2df-d3b1-4a80-b933-bcc1923144f2 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:32.223602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2c0c7-6ce1-4edf-bc9b-e237c8703d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:32.224403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2c0c7-6ce1-4edf-bc9b-e237c8703d34 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.224694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2c0c7-6ce1-4edf-bc9b-e237c8703d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.224976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2c0c7-6ce1-4edf-bc9b-e237c8703d34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.239638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2c0c7-6ce1-4edf-bc9b-e237c8703d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:32.241617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-e1d2c0c7-6ce1-4edf-bc9b-e237c8703d34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:18:32.242847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 23/49] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:32.249102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0330c-dd59-409b-99c8-0e3adf84484a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:32.292129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f4953-4224-4c26-b5b1-3bbba63d35f5 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.292426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f4953-4224-4c26-b5b1-3bbba63d35f5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.292710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f4953-4224-4c26-b5b1-3bbba63d35f5 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.294079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 24/50] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:32.299279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914162f5-2c21-4f8d-a8bf-d81cf13b5a80 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.299578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914162f5-2c21-4f8d-a8bf-d81cf13b5a80 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.299869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914162f5-2c21-4f8d-a8bf-d81cf13b5a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.316999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-914162f5-2c21-4f8d-a8bf-d81cf13b5a80 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:32.318207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-914162f5-2c21-4f8d-a8bf-d81cf13b5a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:32.344102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0330c-dd59-409b-99c8-0e3adf84484a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:32.377097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:32.377861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.378131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.378407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.379192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:32.379503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:32.380895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:32.383071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 25/51] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:18:32.389182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 27/52] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:32.394486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914162f5-2c21-4f8d-a8bf-d81cf13b5a80 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:32.406081 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:32.487163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914162f5-2c21-4f8d-a8bf-d81cf13b5a80 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:32.502590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e3678-2a96-42a2-8783-e60248c91d4d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:32.519577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad36e3-aa09-4d15-95bf-f704880739f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:32.520463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad36e3-aa09-4d15-95bf-f704880739f2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.520751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad36e3-aa09-4d15-95bf-f704880739f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.521031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad36e3-aa09-4d15-95bf-f704880739f2 None admin] PATH_INFO: `/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.522468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad36e3-aa09-4d15-95bf-f704880739f2 None admin] RBAC: Authorizing `identity:get_user(user_id=2df9f80376a24d76bc8b6475e8d5cfc8)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:32.525000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad36e3-aa09-4d15-95bf-f704880739f2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:32.526690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:32 2022] GET /identity/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:32.532118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad36e3-aa09-4d15-95bf-f704880739f2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:32.534935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca47ce-7435-4057-ba72-13f8a5d7579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:32.535735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca47ce-7435-4057-ba72-13f8a5d7579f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.536028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca47ce-7435-4057-ba72-13f8a5d7579f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.536304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca47ce-7435-4057-ba72-13f8a5d7579f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.537510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca47ce-7435-4057-ba72-13f8a5d7579f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:32.538993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca47ce-7435-4057-ba72-13f8a5d7579f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:32.540727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 28/54] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:32.546504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca47ce-7435-4057-ba72-13f8a5d7579f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:32.624210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad36e3-aa09-4d15-95bf-f704880739f2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:32.639446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca47ce-7435-4057-ba72-13f8a5d7579f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:32.655290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43197afe-572c-490f-bdea-e20bd8bb4e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:32.660665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43197afe-572c-490f-bdea-e20bd8bb4e01 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.660665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43197afe-572c-490f-bdea-e20bd8bb4e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.660665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43197afe-572c-490f-bdea-e20bd8bb4e01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.660665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43197afe-572c-490f-bdea-e20bd8bb4e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:32.660665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43197afe-572c-490f-bdea-e20bd8bb4e01 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:32.661097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:32.666666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43197afe-572c-490f-bdea-e20bd8bb4e01 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:32.676274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37774408-218a-433e-9168-fbe8534b1e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:32.676939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37774408-218a-433e-9168-fbe8534b1e43 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.677234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37774408-218a-433e-9168-fbe8534b1e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.677519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37774408-218a-433e-9168-fbe8534b1e43 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.678237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37774408-218a-433e-9168-fbe8534b1e43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:32.679981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37774408-218a-433e-9168-fbe8534b1e43 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:32.760186 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43197afe-572c-490f-bdea-e20bd8bb4e01 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:32.780006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 29/56] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Apr 28 16:18:32 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:18:32.792459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913564b-d80a-4816-94b5-a4f668750ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:32.793153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913564b-d80a-4816-94b5-a4f668750ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:32.793448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913564b-d80a-4816-94b5-a4f668750ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:32.793732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913564b-d80a-4816-94b5-a4f668750ea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:32.795316 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913564b-d80a-4816-94b5-a4f668750ea9 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.domain.id=default, user.id=2df9f80376a24d76bc8b6475e8d5cfc8) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:32.795642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913564b-d80a-4816-94b5-a4f668750ea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:32.797142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913564b-d80a-4816-94b5-a4f668750ea9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:32.807257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Apr 28 16:18:32 2022] GET /identity/v3/role_assignments?user.id=2df9f80376a24d76bc8b6475e8d5cfc8&scope.domain.id=default&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:35.039072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039468b9-714d-4b29-9876-a8b7da261470 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:35.039580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039468b9-714d-4b29-9876-a8b7da261470 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:35.039659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039468b9-714d-4b29-9876-a8b7da261470 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:35.041013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 30/58] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:35.046335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b6859-dbb9-418a-89ff-cd1b5687e5be None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:35.046865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b6859-dbb9-418a-89ff-cd1b5687e5be None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:35.046952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b6859-dbb9-418a-89ff-cd1b5687e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:35.065230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-8a5b6859-dbb9-418a-89ff-cd1b5687e5be None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:35.066447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8a5b6859-dbb9-418a-89ff-cd1b5687e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:35.132563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:35.157269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039468b9-714d-4b29-9876-a8b7da261470 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:35.253092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039468b9-714d-4b29-9876-a8b7da261470 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:35.285828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da52c7-a1bd-4c0b-bd43-193bf143f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:35.286662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da52c7-a1bd-4c0b-bd43-193bf143f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:35.286953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da52c7-a1bd-4c0b-bd43-193bf143f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:35.287234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da52c7-a1bd-4c0b-bd43-193bf143f1d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:35.288442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da52c7-a1bd-4c0b-bd43-193bf143f1d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:35.289945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da52c7-a1bd-4c0b-bd43-193bf143f1d9 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:35.291540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 31/60] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:35.296911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b6859-dbb9-418a-89ff-cd1b5687e5be None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:35.389133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b6859-dbb9-418a-89ff-cd1b5687e5be None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:35.421772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c06ce-8a11-49c0-be3a-a5a3e5a9f53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:35.422493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c06ce-8a11-49c0-be3a-a5a3e5a9f53b None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:35.422827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c06ce-8a11-49c0-be3a-a5a3e5a9f53b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:35.423110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c06ce-8a11-49c0-be3a-a5a3e5a9f53b None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:35.423847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c06ce-8a11-49c0-be3a-a5a3e5a9f53b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:35.425362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c06ce-8a11-49c0-be3a-a5a3e5a9f53b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:35.532476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 30/61] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:18:35 2022] POST /identity/v3/users => generated 275 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:38.664746 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d7d92-e830-43e6-a2ef-ba7376261cfa None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:38.665253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d7d92-e830-43e6-a2ef-ba7376261cfa None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:38.665325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d7d92-e830-43e6-a2ef-ba7376261cfa None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:38.667008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 32/62] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:38.672439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4636c-81bc-424e-9e57-0e76ba5ada3b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:38.672827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4636c-81bc-424e-9e57-0e76ba5ada3b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:38.673013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4636c-81bc-424e-9e57-0e76ba5ada3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:38.694314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5ed4636c-81bc-424e-9e57-0e76ba5ada3b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:38.698496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5ed4636c-81bc-424e-9e57-0e76ba5ada3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:38.791100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 31/63] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:38.827389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d7d92-e830-43e6-a2ef-ba7376261cfa None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:38.935545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3030788-ef76-4ec2-8ba6-a8ff3cea8f99 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:38.935832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3030788-ef76-4ec2-8ba6-a8ff3cea8f99 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:38.936033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3030788-ef76-4ec2-8ba6-a8ff3cea8f99 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:38.937636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 32/64] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:38.944136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9207a08-4606-4e40-b04a-deebb63bc8d1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:38.944428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9207a08-4606-4e40-b04a-deebb63bc8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:38.944713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9207a08-4606-4e40-b04a-deebb63bc8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:38.959994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d7d92-e830-43e6-a2ef-ba7376261cfa None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:38.972728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b9207a08-4606-4e40-b04a-deebb63bc8d1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:38.974564 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b9207a08-4606-4e40-b04a-deebb63bc8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:39.023700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd1bfa-c37d-4375-8c22-d5038a9370ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:39.024514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd1bfa-c37d-4375-8c22-d5038a9370ce None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.024802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd1bfa-c37d-4375-8c22-d5038a9370ce None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.025086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd1bfa-c37d-4375-8c22-d5038a9370ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.051481 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd1bfa-c37d-4375-8c22-d5038a9370ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:39.064108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-ddfd1bfa-c37d-4375-8c22-d5038a9370ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:18:39.067912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 33/65] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:39.072872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd1bfa-c37d-4375-8c22-d5038a9370ce None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:39.096878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 33/66] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:18:39.169708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9207a08-4606-4e40-b04a-deebb63bc8d1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:39.228461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd1bfa-c37d-4375-8c22-d5038a9370ce None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:39.302859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:39.303552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.303846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.304382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.305153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:39.305468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:39.307703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:39.324632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 34/67] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:39.335540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:39.351101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9207a08-4606-4e40-b04a-deebb63bc8d1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:39.395024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d0ae6-0ac5-4e76-b8ba-53d7909fde3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:39.396792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d0ae6-0ac5-4e76-b8ba-53d7909fde3a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.397287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d0ae6-0ac5-4e76-b8ba-53d7909fde3a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.397765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d0ae6-0ac5-4e76-b8ba-53d7909fde3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.411290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d0ae6-0ac5-4e76-b8ba-53d7909fde3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:39.421143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-3a2d0ae6-0ac5-4e76-b8ba-53d7909fde3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:18:39.422856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 34/68] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:18:39.428455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531b84-82c8-421a-b2b8-c78b8df72073 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.428455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531b84-82c8-421a-b2b8-c78b8df72073 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.428633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b531b84-82c8-421a-b2b8-c78b8df72073 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.430281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 35/69] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:39.434718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b531b84-82c8-421a-b2b8-c78b8df72073 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:39.462204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480b564-a1e7-474b-9279-4a396a398b44 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:39.499370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d25b0-a661-4db7-bc1d-2652a54c7dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:39.500557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d25b0-a661-4db7-bc1d-2652a54c7dad None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.501043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d25b0-a661-4db7-bc1d-2652a54c7dad None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.501537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d25b0-a661-4db7-bc1d-2652a54c7dad None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.514510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d25b0-a661-4db7-bc1d-2652a54c7dad None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:39.516249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d25b0-a661-4db7-bc1d-2652a54c7dad None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:39.518407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 35/70] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:39.519871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5488a3-8064-4899-8892-d498ad9af9f2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.520233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5488a3-8064-4899-8892-d498ad9af9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.520591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5488a3-8064-4899-8892-d498ad9af9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.536719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-2a5488a3-8064-4899-8892-d498ad9af9f2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:39.537897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2a5488a3-8064-4899-8892-d498ad9af9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:39.539906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b531b84-82c8-421a-b2b8-c78b8df72073 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:39.575636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd494e7-fb65-4da9-ab04-f672a9fde43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:39.576433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd494e7-fb65-4da9-ab04-f672a9fde43f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.576720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd494e7-fb65-4da9-ab04-f672a9fde43f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.576999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd494e7-fb65-4da9-ab04-f672a9fde43f None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.577783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd494e7-fb65-4da9-ab04-f672a9fde43f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:39.578095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd494e7-fb65-4da9-ab04-f672a9fde43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:39.579634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd494e7-fb65-4da9-ab04-f672a9fde43f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:39.597275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 36/71] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:39.597275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17a31-7747-45cc-b461-22fa95d2be79 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.597275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17a31-7747-45cc-b461-22fa95d2be79 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.597275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e17a31-7747-45cc-b461-22fa95d2be79 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.597275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 37/72] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:39.598172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e17a31-7747-45cc-b461-22fa95d2be79 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:39.622567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 36/73] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:39.622567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5488a3-8064-4899-8892-d498ad9af9f2 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:39.713743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e17a31-7747-45cc-b461-22fa95d2be79 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:39.719520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5488a3-8064-4899-8892-d498ad9af9f2 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:39.749559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbfdd4-d5d1-4313-9e09-e0c22fbcc122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:39.750145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfdd4-d5d1-4313-9e09-e0c22fbcc122 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.750431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfdd4-d5d1-4313-9e09-e0c22fbcc122 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.750752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbfdd4-d5d1-4313-9e09-e0c22fbcc122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.754440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785519e-d8a2-4744-83a0-620a487917f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:39.755360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785519e-d8a2-4744-83a0-620a487917f3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.755649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785519e-d8a2-4744-83a0-620a487917f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.755933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785519e-d8a2-4744-83a0-620a487917f3 None admin] PATH_INFO: `/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.757140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785519e-d8a2-4744-83a0-620a487917f3 None admin] RBAC: Authorizing `identity:get_user(user_id=2df9f80376a24d76bc8b6475e8d5cfc8)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:39.758816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785519e-d8a2-4744-83a0-620a487917f3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:39.760450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 37/74] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:39.761704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba6a7f-0416-43d9-9bb8-e67c24e72aba None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.761997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba6a7f-0416-43d9-9bb8-e67c24e72aba None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.762285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba6a7f-0416-43d9-9bb8-e67c24e72aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.778062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c7ba6a7f-0416-43d9-9bb8-e67c24e72aba None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:39.779320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c7ba6a7f-0416-43d9-9bb8-e67c24e72aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:39.815109 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbfdd4-d5d1-4313-9e09-e0c22fbcc122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:39.816570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbfdd4-d5d1-4313-9e09-e0c22fbcc122 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:39.842256 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 38/75] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:39.843118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba6a7f-0416-43d9-9bb8-e67c24e72aba None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:39.913232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 38/76] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:39.915683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc63632-7a2a-4003-b9ec-6352330cac1e None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.915991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc63632-7a2a-4003-b9ec-6352330cac1e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.916277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc63632-7a2a-4003-b9ec-6352330cac1e None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.917729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 39/77] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:39.922761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc63632-7a2a-4003-b9ec-6352330cac1e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:39.937140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba6a7f-0416-43d9-9bb8-e67c24e72aba None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:39.969524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59154-8854-4313-8c22-ec8d5efcb5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:39.970334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59154-8854-4313-8c22-ec8d5efcb5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:39.970654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59154-8854-4313-8c22-ec8d5efcb5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:39.970935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59154-8854-4313-8c22-ec8d5efcb5f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:39.980625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c59154-8854-4313-8c22-ec8d5efcb5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:39.988607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-26c59154-8854-4313-8c22-ec8d5efcb5f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:18:39.989801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 39/78] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:39.990575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59154-8854-4313-8c22-ec8d5efcb5f5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.022418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc63632-7a2a-4003-b9ec-6352330cac1e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.056688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364290a-ecf6-44ee-80a9-8bd35b4ee4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.057352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364290a-ecf6-44ee-80a9-8bd35b4ee4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.057643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364290a-ecf6-44ee-80a9-8bd35b4ee4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.057921 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364290a-ecf6-44ee-80a9-8bd35b4ee4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.084896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59154-8854-4313-8c22-ec8d5efcb5f5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.117402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c4792-727a-4839-b9a7-5906986b8b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.118206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4792-727a-4839-b9a7-5906986b8b8b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.118501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4792-727a-4839-b9a7-5906986b8b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.118818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4792-727a-4839-b9a7-5906986b8b8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.121385 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364290a-ecf6-44ee-80a9-8bd35b4ee4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.122917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364290a-ecf6-44ee-80a9-8bd35b4ee4f3 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.128650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c4792-727a-4839-b9a7-5906986b8b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:40.135777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-613c4792-727a-4839-b9a7-5906986b8b8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:18:40.136987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 40/79] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:40.137763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c4792-727a-4839-b9a7-5906986b8b8b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.215609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 40/80] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:40.217479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90412d05-b3de-43a3-a47b-9f830f7d4e5d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.217777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90412d05-b3de-43a3-a47b-9f830f7d4e5d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.218060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90412d05-b3de-43a3-a47b-9f830f7d4e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.231130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c4792-727a-4839-b9a7-5906986b8b8b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.234077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-90412d05-b3de-43a3-a47b-9f830f7d4e5d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:40.235301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-90412d05-b3de-43a3-a47b-9f830f7d4e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:40.263213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25824574-2982-44b1-b4fb-17a09f8c911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.264580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25824574-2982-44b1-b4fb-17a09f8c911f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.264869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25824574-2982-44b1-b4fb-17a09f8c911f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.265151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25824574-2982-44b1-b4fb-17a09f8c911f None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.266334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25824574-2982-44b1-b4fb-17a09f8c911f None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.267836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25824574-2982-44b1-b4fb-17a09f8c911f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.269528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.270279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25824574-2982-44b1-b4fb-17a09f8c911f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.302878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 41/82] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:40.303660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90412d05-b3de-43a3-a47b-9f830f7d4e5d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.365733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25824574-2982-44b1-b4fb-17a09f8c911f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.395068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90412d05-b3de-43a3-a47b-9f830f7d4e5d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.397323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.397998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.398294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.398604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.399365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:40.399681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.401067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.409276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 42/83] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.410068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.428276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.429202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.429496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.429781 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.430571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] RBAC: Adding query filter params (name=member) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:40.430888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.432270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.439915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 42/84] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.440687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.502826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47427f2-41b0-4e47-a22a-69d5243fae7d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.533511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c0373-2255-4ac7-8951-c32914dda488 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.534824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89f3fa-9f6d-4d84-9f1d-bf024801d6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.535687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89f3fa-9f6d-4d84-9f1d-bf024801d6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.535978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89f3fa-9f6d-4d84-9f1d-bf024801d6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.536263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89f3fa-9f6d-4d84-9f1d-bf024801d6d1 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.537472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89f3fa-9f6d-4d84-9f1d-bf024801d6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.538976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89f3fa-9f6d-4d84-9f1d-bf024801d6d1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.540825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 43/85] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.541510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89f3fa-9f6d-4d84-9f1d-bf024801d6d1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.565092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.565750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.566041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.566328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.567206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] RBAC: Adding query filter params (role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f, user.id=2afbe91729da44b8b75f76700e73be12) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:40.567523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.568950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.574126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 43/86] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/role_assignments?user.id=2afbe91729da44b8b75f76700e73be12&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.574925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.649091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89f3fa-9f6d-4d84-9f1d-bf024801d6d1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.680417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c3088-0b38-474f-ad33-0b2292a128e1 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.684067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f7c01-b823-4f58-90d7-816bd880e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.684889 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f7c01-b823-4f58-90d7-816bd880e570 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.685713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f7c01-b823-4f58-90d7-816bd880e570 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.686010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f7c01-b823-4f58-90d7-816bd880e570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.687275 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f7c01-b823-4f58-90d7-816bd880e570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.688791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f7c01-b823-4f58-90d7-816bd880e570 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.690504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 44/87] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.696051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f7c01-b823-4f58-90d7-816bd880e570 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.715047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95214bf-3eda-4875-bd88-903ced3dd3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.715945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95214bf-3eda-4875-bd88-903ced3dd3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.716230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95214bf-3eda-4875-bd88-903ced3dd3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.716627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95214bf-3eda-4875-bd88-903ced3dd3d2 None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.717850 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95214bf-3eda-4875-bd88-903ced3dd3d2 None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.719360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95214bf-3eda-4875-bd88-903ced3dd3d2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.721432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 44/88] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.723058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95214bf-3eda-4875-bd88-903ced3dd3d2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.817555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f7c01-b823-4f58-90d7-816bd880e570 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.833699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95214bf-3eda-4875-bd88-903ced3dd3d2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:40.851260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15feff-3f9c-480c-894c-8d2758ddf258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.852139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15feff-3f9c-480c-894c-8d2758ddf258 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.852429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15feff-3f9c-480c-894c-8d2758ddf258 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.852709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15feff-3f9c-480c-894c-8d2758ddf258 None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.853912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15feff-3f9c-480c-894c-8d2758ddf258 None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.855395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15feff-3f9c-480c-894c-8d2758ddf258 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.857260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 45/89] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.857803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15feff-3f9c-480c-894c-8d2758ddf258 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.870932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:40.871606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:40.871897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:40.872179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:40.873557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f, user.id=2df9f80376a24d76bc8b6475e8d5cfc8) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:40.873874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:40.875369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:40.880977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 45/90] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/role_assignments?user.id=2df9f80376a24d76bc8b6475e8d5cfc8&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:40.883466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:40.982967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15feff-3f9c-480c-894c-8d2758ddf258 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:41.006323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611038a-c096-4b59-abc3-60766d8c81e2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:41.033884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e41b5-1d7d-4458-8fa4-ce31824033f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:41.035137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e41b5-1d7d-4458-8fa4-ce31824033f4 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:41.035982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e41b5-1d7d-4458-8fa4-ce31824033f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:41.036602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e41b5-1d7d-4458-8fa4-ce31824033f4 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:41.037601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e41b5-1d7d-4458-8fa4-ce31824033f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:41.040211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e41b5-1d7d-4458-8fa4-ce31824033f4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:41.044025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee2709-4a8a-4e91-9536-676174f1a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:41.045357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2709-4a8a-4e91-9536-676174f1a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:41.045742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2709-4a8a-4e91-9536-676174f1a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:41.046116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2709-4a8a-4e91-9536-676174f1a4a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:41.125453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee2709-4a8a-4e91-9536-676174f1a4a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:41.126885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee2709-4a8a-4e91-9536-676174f1a4a8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:41.155920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 46/91] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:18:40 2022] POST /identity/v3/users => generated 289 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:41.157131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e41b5-1d7d-4458-8fa4-ce31824033f4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:41.259273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 46/92] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:41.265954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee2709-4a8a-4e91-9536-676174f1a4a8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:41.274881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e41b5-1d7d-4458-8fa4-ce31824033f4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:41.358644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e78ea-82ac-4a3a-bc76-8001d1d6f704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:41.359701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e78ea-82ac-4a3a-bc76-8001d1d6f704 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:41.360220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e78ea-82ac-4a3a-bc76-8001d1d6f704 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:41.360718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e78ea-82ac-4a3a-bc76-8001d1d6f704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:41.444536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e78ea-82ac-4a3a-bc76-8001d1d6f704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:41.446951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e78ea-82ac-4a3a-bc76-8001d1d6f704 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:41.447984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee2709-4a8a-4e91-9536-676174f1a4a8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:41.484509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d39eb0-1c6f-4a83-8813-d1a3048312a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:41.485393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39eb0-1c6f-4a83-8813-d1a3048312a6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:41.485688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39eb0-1c6f-4a83-8813-d1a3048312a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:41.485973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d39eb0-1c6f-4a83-8813-d1a3048312a6 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:41.488058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d39eb0-1c6f-4a83-8813-d1a3048312a6 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:41.489541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d39eb0-1c6f-4a83-8813-d1a3048312a6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:41.491498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 47/93] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:41 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:41.501286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d39eb0-1c6f-4a83-8813-d1a3048312a6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:41.572523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 47/94] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:41.578652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e78ea-82ac-4a3a-bc76-8001d1d6f704 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:41.623453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d39eb0-1c6f-4a83-8813-d1a3048312a6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:41.670775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:41.672117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:41.672806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:41.673301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:41.674673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] RBAC: Adding query filter params (role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f, user.id=2afbe91729da44b8b75f76700e73be12) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:41.675209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:41.676900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:41.683273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 48/95] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:41 2022] GET /identity/v3/role_assignments?user.id=2afbe91729da44b8b75f76700e73be12&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:41.688822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e78ea-82ac-4a3a-bc76-8001d1d6f704 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:41.727337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15076a-2d91-4d3e-b298-b55047a6da47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:41.728586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15076a-2d91-4d3e-b298-b55047a6da47 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:41.729085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15076a-2d91-4d3e-b298-b55047a6da47 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:41.729574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15076a-2d91-4d3e-b298-b55047a6da47 None admin] PATH_INFO: `/v3/projects/5a230d52218445ff8d624cb7a284f781` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:41.731175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15076a-2d91-4d3e-b298-b55047a6da47 None admin] RBAC: Authorizing `identity:get_project(project_id=5a230d52218445ff8d624cb7a284f781)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:41.733591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15076a-2d91-4d3e-b298-b55047a6da47 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:41.735813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 48/96] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:41 2022] GET /identity/v3/projects/5a230d52218445ff8d624cb7a284f781 => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:41.743712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:41.863695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799a422-b5a8-41c9-9b81-7e6c62009687 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:41.905152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee65ad4-1961-498a-87a5-01cfbfbd7805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:41.905825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee65ad4-1961-498a-87a5-01cfbfbd7805 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:41.906122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee65ad4-1961-498a-87a5-01cfbfbd7805 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:41.906410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee65ad4-1961-498a-87a5-01cfbfbd7805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:41.907315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee65ad4-1961-498a-87a5-01cfbfbd7805 None admin] RBAC: Adding query filter params (role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=5a230d52218445ff8d624cb7a284f781, user.id=2afbe91729da44b8b75f76700e73be12) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:41.907638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee65ad4-1961-498a-87a5-01cfbfbd7805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:41.909114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee65ad4-1961-498a-87a5-01cfbfbd7805 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:41.917753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 49/97] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:41 2022] GET /identity/v3/role_assignments?user.id=2afbe91729da44b8b75f76700e73be12&scope.project.id=5a230d52218445ff8d624cb7a284f781&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:43.277531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4106294-ee98-4003-8e57-7733cf492617 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:43.278597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4106294-ee98-4003-8e57-7733cf492617 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:43.279652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4106294-ee98-4003-8e57-7733cf492617 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:43.281335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 49/98] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:43.287481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d8251-a9d5-42f4-ba54-4ee501746d9b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:43.287994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d8251-a9d5-42f4-ba54-4ee501746d9b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:43.288110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d8251-a9d5-42f4-ba54-4ee501746d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:43.311135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-397d8251-a9d5-42f4-ba54-4ee501746d9b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:43.312382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-397d8251-a9d5-42f4-ba54-4ee501746d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:43.400704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 50/99] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:43.432036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4106294-ee98-4003-8e57-7733cf492617 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:43.564264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4106294-ee98-4003-8e57-7733cf492617 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:43.582565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e8dc-46a9-454b-924b-8ab477f6a9a3 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:43.582565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e8dc-46a9-454b-924b-8ab477f6a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:43.582565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e8dc-46a9-454b-924b-8ab477f6a9a3 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:43.583490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 51/100] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:43.592395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6069c-7330-4759-9586-93a7325f39ff None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:43.592691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6069c-7330-4759-9586-93a7325f39ff None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:43.592978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6069c-7330-4759-9586-93a7325f39ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:43.610176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496dc7a-a912-426f-be96-82a2c6c248e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:43.611414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dc7a-a912-426f-be96-82a2c6c248e7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:43.611926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dc7a-a912-426f-be96-82a2c6c248e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:43.612402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dc7a-a912-426f-be96-82a2c6c248e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:43.615817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f8a6069c-7330-4759-9586-93a7325f39ff None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:43.615817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f8a6069c-7330-4759-9586-93a7325f39ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:43.625802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496dc7a-a912-426f-be96-82a2c6c248e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:43.641834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-0496dc7a-a912-426f-be96-82a2c6c248e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:18:43.643538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 50/101] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:18:43.649397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496dc7a-a912-426f-be96-82a2c6c248e7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:43.701703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 52/102] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:18:43.744006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6069c-7330-4759-9586-93a7325f39ff None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:43.754095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496dc7a-a912-426f-be96-82a2c6c248e7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:43.791692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:43.792748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:43.793245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:43.793732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:43.796581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:43.797797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:43.800578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:43.827940 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 51/103] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:43.839053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:43.939934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6069c-7330-4759-9586-93a7325f39ff None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:43.974463 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c833-0859-4f26-bf59-92acfbdd338f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:44.008794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4ba79-4853-4901-906f-f05560b65b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:44.010043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ba79-4853-4901-906f-f05560b65b42 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:44.010560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ba79-4853-4901-906f-f05560b65b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:44.011062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4ba79-4853-4901-906f-f05560b65b42 None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:44.012755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4ba79-4853-4901-906f-f05560b65b42 None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:44.014462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4ba79-4853-4901-906f-f05560b65b42 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:44.016818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 52/104] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:43 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:44.017702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47aef1-c38f-487e-a945-72b73af86723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:44.018769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47aef1-c38f-487e-a945-72b73af86723 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:44.019269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47aef1-c38f-487e-a945-72b73af86723 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:44.019752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47aef1-c38f-487e-a945-72b73af86723 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:44.030353 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4ba79-4853-4901-906f-f05560b65b42 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:44.056096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47aef1-c38f-487e-a945-72b73af86723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:44.063811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-0c47aef1-c38f-487e-a945-72b73af86723 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:18:44.065243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 53/105] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:18:44.071240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47aef1-c38f-487e-a945-72b73af86723 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:44.198709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4ba79-4853-4901-906f-f05560b65b42 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:44.243250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f2fc-2e4d-4574-998c-e995bb16b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:44.246782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f2fc-2e4d-4574-998c-e995bb16b377 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:44.246782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f2fc-2e4d-4574-998c-e995bb16b377 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:44.246782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f2fc-2e4d-4574-998c-e995bb16b377 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:44.248718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952f2fc-2e4d-4574-998c-e995bb16b377 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:44.250686 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952f2fc-2e4d-4574-998c-e995bb16b377 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:44.253614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 53/106] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:44 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:44.259681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f2fc-2e4d-4574-998c-e995bb16b377 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:44.296581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47aef1-c38f-487e-a945-72b73af86723 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:44.448813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:44.449428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:44.449719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:44.449992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:44.450829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:44.451207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:44.453702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:44.473596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 54/107] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:44.480822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:44.507785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f2fc-2e4d-4574-998c-e995bb16b377 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:44.567311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48bb54-e22e-4960-bf59-88556f172062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:44.568230 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48bb54-e22e-4960-bf59-88556f172062 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:44.568524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48bb54-e22e-4960-bf59-88556f172062 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:44.568810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48bb54-e22e-4960-bf59-88556f172062 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/users/2afbe91729da44b8b75f76700e73be12/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:44.570972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48bb54-e22e-4960-bf59-88556f172062 None admin] RBAC: Authorizing `identity:create_grant(project_id=49a1ec22021e42d1aa1d63a70d01395f, user_id=2afbe91729da44b8b75f76700e73be12, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:44.572663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48bb54-e22e-4960-bf59-88556f172062 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:44.605645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f655ebd-8301-4985-9ac8-ed6df2ca13fb None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:44.644554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 54/108] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:18:44 2022] PUT /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/users/2afbe91729da44b8b75f76700e73be12/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:18:44.649098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e4c2-125a-4830-9b54-0115ca4c2d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:44.649986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e4c2-125a-4830-9b54-0115ca4c2d99 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:44.650271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e4c2-125a-4830-9b54-0115ca4c2d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:44.650564 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9e4c2-125a-4830-9b54-0115ca4c2d99 None admin] PATH_INFO: `/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:44.651934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e4c2-125a-4830-9b54-0115ca4c2d99 None admin] RBAC: Authorizing `identity:get_user(user_id=2df9f80376a24d76bc8b6475e8d5cfc8)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:44.653612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9e4c2-125a-4830-9b54-0115ca4c2d99 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:44.656082 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 55/109] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:44 2022] GET /identity/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:44.662389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48bb54-e22e-4960-bf59-88556f172062 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:44.782151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48bb54-e22e-4960-bf59-88556f172062 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:44.826881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe095f9-45c8-4aaa-8c27-65195fee714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:44.828056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe095f9-45c8-4aaa-8c27-65195fee714b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:44.828494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe095f9-45c8-4aaa-8c27-65195fee714b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:44.828941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe095f9-45c8-4aaa-8c27-65195fee714b None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:44.830416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe095f9-45c8-4aaa-8c27-65195fee714b None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:44.832107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe095f9-45c8-4aaa-8c27-65195fee714b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:44.834439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 55/110] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:44 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:44.840861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e4c2-125a-4830-9b54-0115ca4c2d99 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:44.980896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9e4c2-125a-4830-9b54-0115ca4c2d99 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:45.025111 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4b9f5-539a-4fd3-97ce-47b4f0e2035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:45.026022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4b9f5-539a-4fd3-97ce-47b4f0e2035f None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.026310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4b9f5-539a-4fd3-97ce-47b4f0e2035f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.026624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4b9f5-539a-4fd3-97ce-47b4f0e2035f None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/users/2df9f80376a24d76bc8b6475e8d5cfc8/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.028668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4b9f5-539a-4fd3-97ce-47b4f0e2035f None admin] RBAC: Authorizing `identity:create_grant(project_id=49a1ec22021e42d1aa1d63a70d01395f, user_id=2df9f80376a24d76bc8b6475e8d5cfc8, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:45.030848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4b9f5-539a-4fd3-97ce-47b4f0e2035f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:45.040301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3724-b3fd-4080-afd9-1bf0f1a712e3 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.040884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3724-b3fd-4080-afd9-1bf0f1a712e3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.041389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3724-b3fd-4080-afd9-1bf0f1a712e3 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.043058 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 56/111] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:45.052096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd3e6-9c0d-444e-a26f-acef13f32a97 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.052393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd3e6-9c0d-444e-a26f-acef13f32a97 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.052748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd3e6-9c0d-444e-a26f-acef13f32a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.071586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a7dbd3e6-9c0d-444e-a26f-acef13f32a97 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:45.073306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a7dbd3e6-9c0d-444e-a26f-acef13f32a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:45.153390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 56/112] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:18:44 2022] PUT /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/users/2df9f80376a24d76bc8b6475e8d5cfc8/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:18:45.164687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 57/113] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:45.201319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4b9f5-539a-4fd3-97ce-47b4f0e2035f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:45.284902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d45e9-3046-4a16-87fb-23ada2401202 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.285480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d45e9-3046-4a16-87fb-23ada2401202 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.285951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d45e9-3046-4a16-87fb-23ada2401202 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.287684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 58/114] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:45.293733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039425b2-9dfd-4410-aa16-04145edbf101 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.294292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039425b2-9dfd-4410-aa16-04145edbf101 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.294817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039425b2-9dfd-4410-aa16-04145edbf101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.320130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-039425b2-9dfd-4410-aa16-04145edbf101 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:45.321670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-039425b2-9dfd-4410-aa16-04145edbf101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:45.348635 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4b9f5-539a-4fd3-97ce-47b4f0e2035f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:45.389490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644fead-cedc-4a32-a8be-1c1d6a313bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:45.390661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644fead-cedc-4a32-a8be-1c1d6a313bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.391121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644fead-cedc-4a32-a8be-1c1d6a313bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.391941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644fead-cedc-4a32-a8be-1c1d6a313bf5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.404766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644fead-cedc-4a32-a8be-1c1d6a313bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:45.412863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-f644fead-cedc-4a32-a8be-1c1d6a313bf5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:18:45.414928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 57/115] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:45.421583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644fead-cedc-4a32-a8be-1c1d6a313bf5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:45.452968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 59/116] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:45.455002 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2abb6-52c3-4e7d-a8e0-6c5c50d414e4 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.455518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2abb6-52c3-4e7d-a8e0-6c5c50d414e4 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.456163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2abb6-52c3-4e7d-a8e0-6c5c50d414e4 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.457737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 60/117] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:45.464345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940cd4-b3e8-441b-b205-6d24773bfe26 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.464952 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940cd4-b3e8-441b-b205-6d24773bfe26 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.465460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940cd4-b3e8-441b-b205-6d24773bfe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.489731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-53940cd4-b3e8-441b-b205-6d24773bfe26 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:45.491667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-53940cd4-b3e8-441b-b205-6d24773bfe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:45.568687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 61/118] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:45.569552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940cd4-b3e8-441b-b205-6d24773bfe26 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:45.586695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644fead-cedc-4a32-a8be-1c1d6a313bf5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:45.620533 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e08e8a-5930-4494-86e8-f292f9b0ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:45.621595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08e8a-5930-4494-86e8-f292f9b0ff2e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.622076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08e8a-5930-4494-86e8-f292f9b0ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.623256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e08e8a-5930-4494-86e8-f292f9b0ff2e None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.624228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e08e8a-5930-4494-86e8-f292f9b0ff2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:45.624740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e08e8a-5930-4494-86e8-f292f9b0ff2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:45.626383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e08e8a-5930-4494-86e8-f292f9b0ff2e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:45.634759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 58/119] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:45.636376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e79e-572f-401a-ac8b-c7a8ee605e0e None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.636902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e79e-572f-401a-ac8b-c7a8ee605e0e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.637374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161e79e-572f-401a-ac8b-c7a8ee605e0e None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.638875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 59/120] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:45.639760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161e79e-572f-401a-ac8b-c7a8ee605e0e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:45.667717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940cd4-b3e8-441b-b205-6d24773bfe26 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:45.702791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d6b2b-f0d1-4cfa-9731-3780eb9ed640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:45.703601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6b2b-f0d1-4cfa-9731-3780eb9ed640 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.703890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6b2b-f0d1-4cfa-9731-3780eb9ed640 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.704172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6b2b-f0d1-4cfa-9731-3780eb9ed640 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.714627 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d6b2b-f0d1-4cfa-9731-3780eb9ed640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:45.721689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-066d6b2b-f0d1-4cfa-9731-3780eb9ed640 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:18:45.722960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 62/121] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:45.724237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040a47-9d27-41a4-81dc-934fe5dc60a3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.724440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040a47-9d27-41a4-81dc-934fe5dc60a3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.724724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca040a47-9d27-41a4-81dc-934fe5dc60a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.741697 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ca040a47-9d27-41a4-81dc-934fe5dc60a3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:45.742944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ca040a47-9d27-41a4-81dc-934fe5dc60a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:45.746091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161e79e-572f-401a-ac8b-c7a8ee605e0e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:45.780769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9161e7-3a37-428a-96b7-0b63df494dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:45.781963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9161e7-3a37-428a-96b7-0b63df494dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.782475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9161e7-3a37-428a-96b7-0b63df494dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.782992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9161e7-3a37-428a-96b7-0b63df494dc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.793633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9161e7-3a37-428a-96b7-0b63df494dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:45.801971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-ee9161e7-3a37-428a-96b7-0b63df494dc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:18:45.803445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 60/122] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:45.804727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9161e7-3a37-428a-96b7-0b63df494dc5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:45.811008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 63/123] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:45.811707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca040a47-9d27-41a4-81dc-934fe5dc60a3 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:45.908097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9161e7-3a37-428a-96b7-0b63df494dc5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:45.944726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca040a47-9d27-41a4-81dc-934fe5dc60a3 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:45.945298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341ca58-29a4-4b3c-a50f-29b2eeb107a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:45.946423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341ca58-29a4-4b3c-a50f-29b2eeb107a0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.946943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341ca58-29a4-4b3c-a50f-29b2eeb107a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.947292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341ca58-29a4-4b3c-a50f-29b2eeb107a0 None admin] PATH_INFO: `/v3/users/5339f849803d41e7b6f8281f132bd38d` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.962727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341ca58-29a4-4b3c-a50f-29b2eeb107a0 None admin] RBAC: Authorizing `identity:get_user(user_id=5339f849803d41e7b6f8281f132bd38d)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:45.964306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341ca58-29a4-4b3c-a50f-29b2eeb107a0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:45.966973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 61/124] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:45 2022] GET /identity/v3/users/5339f849803d41e7b6f8281f132bd38d => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:45.967817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341ca58-29a4-4b3c-a50f-29b2eeb107a0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:45.986124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:45.987355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:45.987847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:45.988305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:45.989238 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:45.990114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:45.992003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.003634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 64/125] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:46.004660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.082179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341ca58-29a4-4b3c-a50f-29b2eeb107a0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.116086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1b1f-2c2e-48c2-980d-c3ecf264b0bb None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.117286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.118255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.118767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.119261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.120229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:46.120748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.122343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.131105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 62/126] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:46.132234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.150202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07d49-1c41-4ad2-a861-fd08242b5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.151073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07d49-1c41-4ad2-a861-fd08242b5907 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.151359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07d49-1c41-4ad2-a861-fd08242b5907 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.151630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df07d49-1c41-4ad2-a861-fd08242b5907 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.152846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07d49-1c41-4ad2-a861-fd08242b5907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.154908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df07d49-1c41-4ad2-a861-fd08242b5907 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.161293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 65/127] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:46.162098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07d49-1c41-4ad2-a861-fd08242b5907 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.238394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e243c-1cd6-4473-8d3d-9f88a21507b8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.264011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df07d49-1c41-4ad2-a861-fd08242b5907 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.273214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97894d-c971-4ac7-895c-6710729fa774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.274244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97894d-c971-4ac7-895c-6710729fa774 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.274781 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97894d-c971-4ac7-895c-6710729fa774 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.275258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97894d-c971-4ac7-895c-6710729fa774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.300362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc621db-10ed-4f31-b6fd-0fbdafd16f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.301274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc621db-10ed-4f31-b6fd-0fbdafd16f8c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.301532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc621db-10ed-4f31-b6fd-0fbdafd16f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.301816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc621db-10ed-4f31-b6fd-0fbdafd16f8c None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.303112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc621db-10ed-4f31-b6fd-0fbdafd16f8c None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.304835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc621db-10ed-4f31-b6fd-0fbdafd16f8c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.306562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 66/128] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:46 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:46.307260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc621db-10ed-4f31-b6fd-0fbdafd16f8c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.348590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97894d-c971-4ac7-895c-6710729fa774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.350390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97894d-c971-4ac7-895c-6710729fa774 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.408301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc621db-10ed-4f31-b6fd-0fbdafd16f8c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.441960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6109c-a564-4bb5-a327-4e1af07bd519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.442872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6109c-a564-4bb5-a327-4e1af07bd519 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.443074 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6109c-a564-4bb5-a327-4e1af07bd519 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.443358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6109c-a564-4bb5-a327-4e1af07bd519 None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.444566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6109c-a564-4bb5-a327-4e1af07bd519 None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.446390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6109c-a564-4bb5-a327-4e1af07bd519 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.447890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 67/129] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:46 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:46.448644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6109c-a564-4bb5-a327-4e1af07bd519 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.451248 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 63/130] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:46.452386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97894d-c971-4ac7-895c-6710729fa774 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.551101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97894d-c971-4ac7-895c-6710729fa774 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.551830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6109c-a564-4bb5-a327-4e1af07bd519 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.585612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fad873-b462-47d1-b9c3-32ff4aff4864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.586427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c99d-099e-46a0-ae5a-9c9308a28b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.586909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fad873-b462-47d1-b9c3-32ff4aff4864 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.587138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fad873-b462-47d1-b9c3-32ff4aff4864 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.587518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fad873-b462-47d1-b9c3-32ff4aff4864 None admin] PATH_INFO: `/v3/projects/5a230d52218445ff8d624cb7a284f781` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.588024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c99d-099e-46a0-ae5a-9c9308a28b25 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.588454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c99d-099e-46a0-ae5a-9c9308a28b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.588872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c99d-099e-46a0-ae5a-9c9308a28b25 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.589057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fad873-b462-47d1-b9c3-32ff4aff4864 None admin] RBAC: Authorizing `identity:get_project(project_id=5a230d52218445ff8d624cb7a284f781)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.589890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071c99d-099e-46a0-ae5a-9c9308a28b25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.590751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fad873-b462-47d1-b9c3-32ff4aff4864 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.592233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071c99d-099e-46a0-ae5a-9c9308a28b25 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.593499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 64/131] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:46 2022] GET /identity/v3/projects/5a230d52218445ff8d624cb7a284f781 => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:46.594527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fad873-b462-47d1-b9c3-32ff4aff4864 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.675001 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 68/132] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:18:46 2022] POST /identity/v3/projects => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:46.676680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c99d-099e-46a0-ae5a-9c9308a28b25 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.693122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fad873-b462-47d1-b9c3-32ff4aff4864 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.731779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7a1d2-2f57-4fee-88c5-ac36a8c4692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.732897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7a1d2-2f57-4fee-88c5-ac36a8c4692b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.733278 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7a1d2-2f57-4fee-88c5-ac36a8c4692b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.733706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7a1d2-2f57-4fee-88c5-ac36a8c4692b None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.735212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7a1d2-2f57-4fee-88c5-ac36a8c4692b None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.736955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7a1d2-2f57-4fee-88c5-ac36a8c4692b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.739308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 65/133] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:46 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:46.740027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7a1d2-2f57-4fee-88c5-ac36a8c4692b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.810603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c99d-099e-46a0-ae5a-9c9308a28b25 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.852079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1a7d4-fc9d-43ed-b952-6fb2ebd7b87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:46.852965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1a7d4-fc9d-43ed-b952-6fb2ebd7b87f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:46.853254 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1a7d4-fc9d-43ed-b952-6fb2ebd7b87f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:46.853535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1a7d4-fc9d-43ed-b952-6fb2ebd7b87f None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:46.855241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1a7d4-fc9d-43ed-b952-6fb2ebd7b87f None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:46.857068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1a7d4-fc9d-43ed-b952-6fb2ebd7b87f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:46.858688 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 69/134] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:46 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:46.863759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1a7d4-fc9d-43ed-b952-6fb2ebd7b87f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:46.916759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7a1d2-2f57-4fee-88c5-ac36a8c4692b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:46.974481 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1a7d4-fc9d-43ed-b952-6fb2ebd7b87f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:47.000473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd5d5d-92e7-4e99-a06b-b3f4607eb153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:47.001719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5d5d-92e7-4e99-a06b-b3f4607eb153 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:47.002204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5d5d-92e7-4e99-a06b-b3f4607eb153 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:47.002499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd5d5d-92e7-4e99-a06b-b3f4607eb153 None admin] PATH_INFO: `/v3/projects/5a230d52218445ff8d624cb7a284f781/users/2afbe91729da44b8b75f76700e73be12/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:47.007133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd5d5d-92e7-4e99-a06b-b3f4607eb153 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a230d52218445ff8d624cb7a284f781, user_id=2afbe91729da44b8b75f76700e73be12, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:47.009090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd5d5d-92e7-4e99-a06b-b3f4607eb153 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:47.023360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472404e-ac85-4347-a495-acb88b49c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:47.024279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472404e-ac85-4347-a495-acb88b49c678 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:47.024610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472404e-ac85-4347-a495-acb88b49c678 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:47.024903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472404e-ac85-4347-a495-acb88b49c678 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/users/2afbe91729da44b8b75f76700e73be12/roles/caa40465e0b0487aa66fec9cda30ce92` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:47.027236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472404e-ac85-4347-a495-acb88b49c678 None admin] RBAC: Authorizing `identity:create_grant(project_id=49a1ec22021e42d1aa1d63a70d01395f, user_id=2afbe91729da44b8b75f76700e73be12, role_id=caa40465e0b0487aa66fec9cda30ce92)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:47.028735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472404e-ac85-4347-a495-acb88b49c678 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:47.098613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 66/135] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:18:46 2022] PUT /identity/v3/projects/5a230d52218445ff8d624cb7a284f781/users/2afbe91729da44b8b75f76700e73be12/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:18:47.099742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd5d5d-92e7-4e99-a06b-b3f4607eb153 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:47.125567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 70/136] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:18:46 2022] PUT /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/users/2afbe91729da44b8b75f76700e73be12/roles/caa40465e0b0487aa66fec9cda30ce92 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:18:47.233086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd5d5d-92e7-4e99-a06b-b3f4607eb153 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:47.274299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a3a15-3c1e-4d2f-bfb0-394c4f3b1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:47.275247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3a15-3c1e-4d2f-bfb0-394c4f3b1460 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:47.275683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3a15-3c1e-4d2f-bfb0-394c4f3b1460 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:47.276129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3a15-3c1e-4d2f-bfb0-394c4f3b1460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:47.277173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3a15-3c1e-4d2f-bfb0-394c4f3b1460 None admin] RBAC: Adding query filter params (role.id=5f2d9f744a2144228e697cda974d0a93, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f, user.id=5339f849803d41e7b6f8281f132bd38d) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:47.277652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3a15-3c1e-4d2f-bfb0-394c4f3b1460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:47.279402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3a15-3c1e-4d2f-bfb0-394c4f3b1460 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:47.286312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 67/137] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:47 2022] GET /identity/v3/role_assignments?user.id=5339f849803d41e7b6f8281f132bd38d&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=5f2d9f744a2144228e697cda974d0a93 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:47.742146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979fdd-d570-4043-944e-d7100e429e07 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:47.743060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979fdd-d570-4043-944e-d7100e429e07 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:47.743522 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979fdd-d570-4043-944e-d7100e429e07 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:47.745127 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 71/138] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:47.759173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76c1a-e32a-4438-99a9-c010810886c0 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:47.760119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76c1a-e32a-4438-99a9-c010810886c0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:47.760615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76c1a-e32a-4438-99a9-c010810886c0 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:47.762458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 68/139] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:47.765921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226a73-5b28-45a1-8d29-0640eb41b399 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:47.766459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226a73-5b28-45a1-8d29-0640eb41b399 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:47.766987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226a73-5b28-45a1-8d29-0640eb41b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:47.774126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6afd-0c4b-4e34-82e0-9474f535f162 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:47.774701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6afd-0c4b-4e34-82e0-9474f535f162 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:47.779573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6afd-0c4b-4e34-82e0-9474f535f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:47.789157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b4226a73-5b28-45a1-8d29-0640eb41b399 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:47.797832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b4226a73-5b28-45a1-8d29-0640eb41b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:47.815099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e15e6afd-0c4b-4e34-82e0-9474f535f162 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:47.816620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e15e6afd-0c4b-4e34-82e0-9474f535f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:47.935900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 72/140] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:18:47.945702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 69/141] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:47.965593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4226a73-5b28-45a1-8d29-0640eb41b399 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:47.988042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e6afd-0c4b-4e34-82e0-9474f535f162 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:48.175040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e6afd-0c4b-4e34-82e0-9474f535f162 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:48.230522 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4226a73-5b28-45a1-8d29-0640eb41b399 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:48.238552 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4752-00d0-4319-8506-0bddffcba050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:48.247021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4752-00d0-4319-8506-0bddffcba050 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:48.247021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4752-00d0-4319-8506-0bddffcba050 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:48.247021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4752-00d0-4319-8506-0bddffcba050 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:48.254845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab4752-00d0-4319-8506-0bddffcba050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:48.263515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-05ab4752-00d0-4319-8506-0bddffcba050 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:18:48.265030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 70/142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:48.272116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4752-00d0-4319-8506-0bddffcba050 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:48.323360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118ad9-918f-4c58-996c-a26d3a8bdfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:48.324196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118ad9-918f-4c58-996c-a26d3a8bdfcb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:48.324492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118ad9-918f-4c58-996c-a26d3a8bdfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:48.324776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118ad9-918f-4c58-996c-a26d3a8bdfcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:48.363580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af118ad9-918f-4c58-996c-a26d3a8bdfcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:48.370679 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-af118ad9-918f-4c58-996c-a26d3a8bdfcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:18:48.371958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 73/143] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:48.377851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118ad9-918f-4c58-996c-a26d3a8bdfcb None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:48.444727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4752-00d0-4319-8506-0bddffcba050 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:48.503310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:48.504017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:48.504314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:48.504599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:48.505376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] RBAC: Adding query filter params (name=member) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:48.505691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:48.507147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:48.524893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 71/144] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:48.532069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:48.631220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af118ad9-918f-4c58-996c-a26d3a8bdfcb None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:48.719291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:48.719988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:48.720281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:48.720563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:48.721630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:48.722184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:48.724662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:48.738354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 74/145] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:48.746473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:48.748416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5b0d8-cd6a-4f9f-9248-87619d214092 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:48.807856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd4a05-a3d2-434f-9f7e-934f122aa4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:48.808768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4a05-a3d2-434f-9f7e-934f122aa4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:48.809063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4a05-a3d2-434f-9f7e-934f122aa4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:48.809350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd4a05-a3d2-434f-9f7e-934f122aa4b7 None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:48.815320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd4a05-a3d2-434f-9f7e-934f122aa4b7 None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:48.816822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd4a05-a3d2-434f-9f7e-934f122aa4b7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:48.818873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 72/146] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:48 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:48.824732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd4a05-a3d2-434f-9f7e-934f122aa4b7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:49.016843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf8f28-0b12-44cb-8ba4-a048131af9c9 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:49.026482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd4a05-a3d2-434f-9f7e-934f122aa4b7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:49.095576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2490e46-a084-4ab7-b5d2-bcb80806226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:49.096812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490e46-a084-4ab7-b5d2-bcb80806226f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:49.102566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490e46-a084-4ab7-b5d2-bcb80806226f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:49.103267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490e46-a084-4ab7-b5d2-bcb80806226f None admin] PATH_INFO: `/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:49.104860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2490e46-a084-4ab7-b5d2-bcb80806226f None admin] RBAC: Authorizing `identity:get_user(user_id=2df9f80376a24d76bc8b6475e8d5cfc8)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:49.106514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2490e46-a084-4ab7-b5d2-bcb80806226f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:49.109430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 75/147] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:48 2022] GET /identity/v3/users/2df9f80376a24d76bc8b6475e8d5cfc8 => generated 247 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:49.115513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2490e46-a084-4ab7-b5d2-bcb80806226f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:49.127792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319669-8b58-4be9-8fa6-7b29efddcb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:49.128469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319669-8b58-4be9-8fa6-7b29efddcb16 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:49.128958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319669-8b58-4be9-8fa6-7b29efddcb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:49.129086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319669-8b58-4be9-8fa6-7b29efddcb16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:49.228982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2490e46-a084-4ab7-b5d2-bcb80806226f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:49.270570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8af06-0c10-4442-8114-e288739261ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:49.271552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8af06-0c10-4442-8114-e288739261ff None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:49.272093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8af06-0c10-4442-8114-e288739261ff None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:49.272590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8af06-0c10-4442-8114-e288739261ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:49.311602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319669-8b58-4be9-8fa6-7b29efddcb16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:49.313089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319669-8b58-4be9-8fa6-7b29efddcb16 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:49.348423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8af06-0c10-4442-8114-e288739261ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:49.350257 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8af06-0c10-4442-8114-e288739261ff None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:49.460211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 76/148] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 16:18:49.466569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8af06-0c10-4442-8114-e288739261ff None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:49.530159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 73/149] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 16:18:49.537272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319669-8b58-4be9-8fa6-7b29efddcb16 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:49.611296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8af06-0c10-4442-8114-e288739261ff None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:49.667504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf28350-12e0-400d-bfad-171637bb0e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:49.668390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf28350-12e0-400d-bfad-171637bb0e71 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:49.668683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf28350-12e0-400d-bfad-171637bb0e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:49.668979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf28350-12e0-400d-bfad-171637bb0e71 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:49.670814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf28350-12e0-400d-bfad-171637bb0e71 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:49.672827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf28350-12e0-400d-bfad-171637bb0e71 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:49.676078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 77/150] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:49 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:49.681990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf28350-12e0-400d-bfad-171637bb0e71 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:49.728481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319669-8b58-4be9-8fa6-7b29efddcb16 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:49.792071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3346-c4e0-42ff-a9ac-e1ca7d05b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:49.793274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3346-c4e0-42ff-a9ac-e1ca7d05b821 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:49.793757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3346-c4e0-42ff-a9ac-e1ca7d05b821 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:49.794286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3346-c4e0-42ff-a9ac-e1ca7d05b821 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:49.796245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a3346-c4e0-42ff-a9ac-e1ca7d05b821 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:49.802559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a3346-c4e0-42ff-a9ac-e1ca7d05b821 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:49.804921 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 74/151] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:49 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:49.807016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf28350-12e0-400d-bfad-171637bb0e71 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:49.810766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3346-c4e0-42ff-a9ac-e1ca7d05b821 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:49.853239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456eefe-037c-4635-ac09-d964f34340d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:49.855312 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456eefe-037c-4635-ac09-d964f34340d9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:49.855887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456eefe-037c-4635-ac09-d964f34340d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:49.856850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456eefe-037c-4635-ac09-d964f34340d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:49.858644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456eefe-037c-4635-ac09-d964f34340d9 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f, user.id=2df9f80376a24d76bc8b6475e8d5cfc8) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:49.860602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456eefe-037c-4635-ac09-d964f34340d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:49.863244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456eefe-037c-4635-ac09-d964f34340d9 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:49.880671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 78/152] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:49 2022] GET /identity/v3/role_assignments?user.id=2df9f80376a24d76bc8b6475e8d5cfc8&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:49.972736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3346-c4e0-42ff-a9ac-e1ca7d05b821 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:50.020369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118c778-0e6b-46d2-a645-8b64ee042958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:50.021437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c778-0e6b-46d2-a645-8b64ee042958 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.021948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c778-0e6b-46d2-a645-8b64ee042958 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.022475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c778-0e6b-46d2-a645-8b64ee042958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.023577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118c778-0e6b-46d2-a645-8b64ee042958 None admin] RBAC: Adding query filter params (role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f, user.id=2afbe91729da44b8b75f76700e73be12) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:50.024112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118c778-0e6b-46d2-a645-8b64ee042958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:50.025862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118c778-0e6b-46d2-a645-8b64ee042958 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:50.035241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 75/153] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:49 2022] GET /identity/v3/role_assignments?user.id=2afbe91729da44b8b75f76700e73be12&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:50.061455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986789e-21fa-4597-96a1-7c549c5265b2 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.062112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986789e-21fa-4597-96a1-7c549c5265b2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.062635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986789e-21fa-4597-96a1-7c549c5265b2 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.064326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 79/154] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:50.070100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7de19-fd36-48ad-a28e-390e93d320be None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.070786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7de19-fd36-48ad-a28e-390e93d320be None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.071304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7de19-fd36-48ad-a28e-390e93d320be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.092020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-67a7de19-fd36-48ad-a28e-390e93d320be None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:50.093578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-67a7de19-fd36-48ad-a28e-390e93d320be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:50.174242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 76/155] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:50.211508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986789e-21fa-4597-96a1-7c549c5265b2 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:50.347696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986789e-21fa-4597-96a1-7c549c5265b2 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:50.400061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2573842-1340-421e-a282-c936bbb1fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:50.401212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573842-1340-421e-a282-c936bbb1fe54 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.401636 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573842-1340-421e-a282-c936bbb1fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.402051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2573842-1340-421e-a282-c936bbb1fe54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.403492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2573842-1340-421e-a282-c936bbb1fe54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:50.405235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2573842-1340-421e-a282-c936bbb1fe54 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:50.407294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 80/156] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:50.412899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7de19-fd36-48ad-a28e-390e93d320be None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:50.551361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7de19-fd36-48ad-a28e-390e93d320be None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:50.592968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f965-c7d3-44c9-b147-fe2437055f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:50.593159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9cfe3-4ba1-4b13-9663-5b11b1261e82 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.593421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9cfe3-4ba1-4b13-9663-5b11b1261e82 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.593633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9cfe3-4ba1-4b13-9663-5b11b1261e82 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.593735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f965-c7d3-44c9-b147-fe2437055f33 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.593943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f965-c7d3-44c9-b147-fe2437055f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.594231 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0f965-c7d3-44c9-b147-fe2437055f33 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.595086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 81/157] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:50.595374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0f965-c7d3-44c9-b147-fe2437055f33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:50.596968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0f965-c7d3-44c9-b147-fe2437055f33 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:50.599869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3114-d273-4ab4-8d2d-ec146474516c None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.600129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3114-d273-4ab4-8d2d-ec146474516c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.600380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3114-d273-4ab4-8d2d-ec146474516c None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.601774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 82/158] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:50.604022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48249f5a-5a59-44a0-a616-701fd8d4322e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.604314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48249f5a-5a59-44a0-a616-701fd8d4322e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.604596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48249f5a-5a59-44a0-a616-701fd8d4322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.624417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-48249f5a-5a59-44a0-a616-701fd8d4322e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:50.625577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-48249f5a-5a59-44a0-a616-701fd8d4322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:50.696595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 83/159] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:18:50.698032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41c82d-74a6-4798-bede-ed09039ff320 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.698293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41c82d-74a6-4798-bede-ed09039ff320 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.698595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41c82d-74a6-4798-bede-ed09039ff320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.708210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 77/160] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:18:50 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:50.719857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-0e41c82d-74a6-4798-bede-ed09039ff320 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:50.721229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0e41c82d-74a6-4798-bede-ed09039ff320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:50.725841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f965-c7d3-44c9-b147-fe2437055f33 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:50.812916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 84/161] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:50.815731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428197e-a2f7-43be-99d8-9af60c5f5895 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.816157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428197e-a2f7-43be-99d8-9af60c5f5895 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.816557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428197e-a2f7-43be-99d8-9af60c5f5895 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.818326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 85/162] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:50.824049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7e2c3-3959-4dd0-98e0-c407d3a1d0c0 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.824547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7e2c3-3959-4dd0-98e0-c407d3a1d0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.824996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7e2c3-3959-4dd0-98e0-c407d3a1d0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.835675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0f965-c7d3-44c9-b147-fe2437055f33 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:50.845173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-35c7e2c3-3959-4dd0-98e0-c407d3a1d0c0 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:50.846591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-35c7e2c3-3959-4dd0-98e0-c407d3a1d0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:50.873553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e61b-04e0-465b-a351-54e1628d2b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:50.874290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e61b-04e0-465b-a351-54e1628d2b58 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:50.874599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e61b-04e0-465b-a351-54e1628d2b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:50.874878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e61b-04e0-465b-a351-54e1628d2b58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:50.885650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216e61b-04e0-465b-a351-54e1628d2b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:50.893099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-c216e61b-04e0-465b-a351-54e1628d2b58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:18:50.899268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 78/163] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:18:50.899268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e61b-04e0-465b-a351-54e1628d2b58 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:50.926733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 86/164] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:50.927944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7e2c3-3959-4dd0-98e0-c407d3a1d0c0 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.003601 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e61b-04e0-465b-a351-54e1628d2b58 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.049448 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7e2c3-3959-4dd0-98e0-c407d3a1d0c0 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.053213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314be74-512e-4e2a-b4cb-6c6831dc4fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.054718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314be74-512e-4e2a-b4cb-6c6831dc4fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.055412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314be74-512e-4e2a-b4cb-6c6831dc4fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.055919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314be74-512e-4e2a-b4cb-6c6831dc4fd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.073701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314be74-512e-4e2a-b4cb-6c6831dc4fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:51.081160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-5314be74-512e-4e2a-b4cb-6c6831dc4fd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:18:51.086704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 79/165] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:51.087514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314be74-512e-4e2a-b4cb-6c6831dc4fd7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.098831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.099517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.099807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.100104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.100861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:51.101171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:51.103729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:51.111722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 87/166] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:51.112904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.224236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314be74-512e-4e2a-b4cb-6c6831dc4fd7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.235908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517324-b416-42b4-9188-7cb3817e9c4c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.262331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734061c-5c4b-4474-953d-76908b07613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.263234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734061c-5c4b-4474-953d-76908b07613b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.263521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734061c-5c4b-4474-953d-76908b07613b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.263799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734061c-5c4b-4474-953d-76908b07613b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.274788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734061c-5c4b-4474-953d-76908b07613b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:51.277985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.280730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.280730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.280730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.280730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:51.281278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:51.282403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:51.283369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-4734061c-5c4b-4474-953d-76908b07613b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:18:51.284943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 80/167] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:51.285854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734061c-5c4b-4474-953d-76908b07613b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.292709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 88/168] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:51.293675 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.412449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734061c-5c4b-4474-953d-76908b07613b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.413107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69882096-08bc-44a9-828d-8afdd254aba4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.446452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b74be-cad4-41a7-bc48-f7375e5023c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.447443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b74be-cad4-41a7-bc48-f7375e5023c7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.447732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.447846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b74be-cad4-41a7-bc48-f7375e5023c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.448021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b74be-cad4-41a7-bc48-f7375e5023c7 None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.448407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.448743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.449022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.449204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b74be-cad4-41a7-bc48-f7375e5023c7 None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:51.449829 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:51.450142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:51.450735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b74be-cad4-41a7-bc48-f7375e5023c7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:51.451603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:51.452378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 81/169] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:51.453222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b74be-cad4-41a7-bc48-f7375e5023c7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.460530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 89/170] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:51.461225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.552156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b74be-cad4-41a7-bc48-f7375e5023c7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.562332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a8441-243b-467e-8fc0-28cecb32bb5c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.585190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0e1f0-b2c6-4d64-a85a-97ad6cc6e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.586071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0e1f0-b2c6-4d64-a85a-97ad6cc6e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.586351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0e1f0-b2c6-4d64-a85a-97ad6cc6e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.586653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0e1f0-b2c6-4d64-a85a-97ad6cc6e1d8 None admin] PATH_INFO: `/v3/users/5339f849803d41e7b6f8281f132bd38d` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.587845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0e1f0-b2c6-4d64-a85a-97ad6cc6e1d8 None admin] RBAC: Authorizing `identity:get_user(user_id=5339f849803d41e7b6f8281f132bd38d)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:51.589298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0e1f0-b2c6-4d64-a85a-97ad6cc6e1d8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:51.590956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 82/171] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/users/5339f849803d41e7b6f8281f132bd38d => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:51.595241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0e1f0-b2c6-4d64-a85a-97ad6cc6e1d8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.611445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb1032-95c7-4d13-b21b-3853a83b7c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.612120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb1032-95c7-4d13-b21b-3853a83b7c12 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.613770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb1032-95c7-4d13-b21b-3853a83b7c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.614654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb1032-95c7-4d13-b21b-3853a83b7c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.726736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0e1f0-b2c6-4d64-a85a-97ad6cc6e1d8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:51.766416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb1032-95c7-4d13-b21b-3853a83b7c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:51.775167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb1032-95c7-4d13-b21b-3853a83b7c12 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:51.787254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b55f5e-f255-4a5d-bf7f-b91af347fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:51.788140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55f5e-f255-4a5d-bf7f-b91af347fcae None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:51.788426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55f5e-f255-4a5d-bf7f-b91af347fcae None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:51.788702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55f5e-f255-4a5d-bf7f-b91af347fcae None admin] PATH_INFO: `/v3/users/2afbe91729da44b8b75f76700e73be12` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:51.791546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b55f5e-f255-4a5d-bf7f-b91af347fcae None admin] RBAC: Authorizing `identity:get_user(user_id=2afbe91729da44b8b75f76700e73be12)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:51.792983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b55f5e-f255-4a5d-bf7f-b91af347fcae None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:51.794840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 83/172] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/users/2afbe91729da44b8b75f76700e73be12 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:51.795444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b55f5e-f255-4a5d-bf7f-b91af347fcae None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.948982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 90/173] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:51.949682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb1032-95c7-4d13-b21b-3853a83b7c12 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:51.983338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b55f5e-f255-4a5d-bf7f-b91af347fcae None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:52.057779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53ec09-b10a-4870-89c3-e32a69d16bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:52.058688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ec09-b10a-4870-89c3-e32a69d16bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:52.058975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ec09-b10a-4870-89c3-e32a69d16bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:52.059255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ec09-b10a-4870-89c3-e32a69d16bd1 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:52.060605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53ec09-b10a-4870-89c3-e32a69d16bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:52.062052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53ec09-b10a-4870-89c3-e32a69d16bd1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:52.065051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 84/174] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:52.065812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53ec09-b10a-4870-89c3-e32a69d16bd1 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:52.141302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb1032-95c7-4d13-b21b-3853a83b7c12 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:52.181594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61ea53-8ed8-4d36-96a5-bb2a25170110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:52.182418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61ea53-8ed8-4d36-96a5-bb2a25170110 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:52.182822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61ea53-8ed8-4d36-96a5-bb2a25170110 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:52.183196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61ea53-8ed8-4d36-96a5-bb2a25170110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:52.223641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53ec09-b10a-4870-89c3-e32a69d16bd1 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:52.267862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8889477-fd68-452a-ac60-c26ea7c08546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:52.268743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8889477-fd68-452a-ac60-c26ea7c08546 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:52.269028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8889477-fd68-452a-ac60-c26ea7c08546 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:52.269304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8889477-fd68-452a-ac60-c26ea7c08546 None admin] PATH_INFO: `/v3/projects/5a230d52218445ff8d624cb7a284f781` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:52.271327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8889477-fd68-452a-ac60-c26ea7c08546 None admin] RBAC: Authorizing `identity:get_project(project_id=5a230d52218445ff8d624cb7a284f781)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:52.272910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8889477-fd68-452a-ac60-c26ea7c08546 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:52.273183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61ea53-8ed8-4d36-96a5-bb2a25170110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:52.274758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61ea53-8ed8-4d36-96a5-bb2a25170110 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:52.280786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 85/175] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:52 2022] GET /identity/v3/projects/5a230d52218445ff8d624cb7a284f781 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:52.280786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8889477-fd68-452a-ac60-c26ea7c08546 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:52.404525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8889477-fd68-452a-ac60-c26ea7c08546 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:52.457301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188381e2-226f-4340-ae2b-4e5d6b3112e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:52.458732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188381e2-226f-4340-ae2b-4e5d6b3112e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:52.459286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188381e2-226f-4340-ae2b-4e5d6b3112e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:52.459737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188381e2-226f-4340-ae2b-4e5d6b3112e9 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/users/5339f849803d41e7b6f8281f132bd38d/roles/5f2d9f744a2144228e697cda974d0a93` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:52.462990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188381e2-226f-4340-ae2b-4e5d6b3112e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=49a1ec22021e42d1aa1d63a70d01395f, user_id=5339f849803d41e7b6f8281f132bd38d, role_id=5f2d9f744a2144228e697cda974d0a93)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:52.465554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188381e2-226f-4340-ae2b-4e5d6b3112e9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:52.484345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 91/176] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:52.485439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61ea53-8ed8-4d36-96a5-bb2a25170110 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:52.559925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 86/177] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:18:52 2022] PUT /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/users/5339f849803d41e7b6f8281f132bd38d/roles/5f2d9f744a2144228e697cda974d0a93 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:18:52.561039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188381e2-226f-4340-ae2b-4e5d6b3112e9 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:52.647737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61ea53-8ed8-4d36-96a5-bb2a25170110 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:52.720427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:52.721436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:52.721905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:52.722360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:52.723423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] RBAC: Adding query filter params (role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=5a230d52218445ff8d624cb7a284f781, user.id=2afbe91729da44b8b75f76700e73be12) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:52.723924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:52.725614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:52.737293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 92/178] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:52 2022] GET /identity/v3/role_assignments?user.id=2afbe91729da44b8b75f76700e73be12&scope.project.id=5a230d52218445ff8d624cb7a284f781&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:52.766302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188381e2-226f-4340-ae2b-4e5d6b3112e9 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:52.828020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e4e17-5dae-4485-9be0-e59cb9496508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:52.829295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e4e17-5dae-4485-9be0-e59cb9496508 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:52.829772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e4e17-5dae-4485-9be0-e59cb9496508 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:52.830236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e4e17-5dae-4485-9be0-e59cb9496508 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:52.831994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e4e17-5dae-4485-9be0-e59cb9496508 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:52.833745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e4e17-5dae-4485-9be0-e59cb9496508 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:52.835858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 87/179] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:52 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:52.842612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:52.984552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5497-f159-46a4-a81c-112207c6e393 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:53.023996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa522ecf-97d1-4430-b7c6-49beda4227cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:53.024607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522ecf-97d1-4430-b7c6-49beda4227cc None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:53.024896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522ecf-97d1-4430-b7c6-49beda4227cc None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:53.025180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa522ecf-97d1-4430-b7c6-49beda4227cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:53.026043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522ecf-97d1-4430-b7c6-49beda4227cc None admin] RBAC: Adding query filter params (role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f, user.id=2afbe91729da44b8b75f76700e73be12) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:53.026363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522ecf-97d1-4430-b7c6-49beda4227cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:53.027881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa522ecf-97d1-4430-b7c6-49beda4227cc None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:53.034929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 93/180] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:52 2022] GET /identity/v3/role_assignments?user.id=2afbe91729da44b8b75f76700e73be12&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:53.596700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf84e-3f10-45dd-8ca4-54dbe85abd0f None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:53.597549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf84e-3f10-45dd-8ca4-54dbe85abd0f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:53.597979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf84e-3f10-45dd-8ca4-54dbe85abd0f None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:53.599565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 88/181] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:53.604807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bfb3-cfad-4ea2-91dd-19a5ffe90419 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:53.605103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bfb3-cfad-4ea2-91dd-19a5ffe90419 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:53.605391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bfb3-cfad-4ea2-91dd-19a5ffe90419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:53.624003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4b78bfb3-cfad-4ea2-91dd-19a5ffe90419 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:53.625204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4b78bfb3-cfad-4ea2-91dd-19a5ffe90419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:53.694008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26cb8-0b82-4415-8d6c-887ea5faa7fa None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:53.694306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26cb8-0b82-4415-8d6c-887ea5faa7fa None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:53.694604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26cb8-0b82-4415-8d6c-887ea5faa7fa None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:53.696245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 89/182] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:53.709770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 94/183] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:53.710775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91746c-7abf-480b-98a6-bc1d7e99f846 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:53.710953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91746c-7abf-480b-98a6-bc1d7e99f846 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:53.711222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91746c-7abf-480b-98a6-bc1d7e99f846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:53.737131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1b91746c-7abf-480b-98a6-bc1d7e99f846 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:53.738331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1b91746c-7abf-480b-98a6-bc1d7e99f846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:53.745600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78bfb3-cfad-4ea2-91dd-19a5ffe90419 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:53.819205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 90/184] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:53.849156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91746c-7abf-480b-98a6-bc1d7e99f846 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:53.859851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78bfb3-cfad-4ea2-91dd-19a5ffe90419 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:53.895586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb666e2-a93c-436c-9f80-18619b930676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:53.896332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb666e2-a93c-436c-9f80-18619b930676 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:53.896624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb666e2-a93c-436c-9f80-18619b930676 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:53.896904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb666e2-a93c-436c-9f80-18619b930676 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:53.907368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb666e2-a93c-436c-9f80-18619b930676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:53.914473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-8cb666e2-a93c-436c-9f80-18619b930676 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:18:53.916032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 95/185] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:53.921948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb666e2-a93c-436c-9f80-18619b930676 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:53.952463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91746c-7abf-480b-98a6-bc1d7e99f846 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:53.986397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf4281-3e3f-4f29-bd3d-edd06435136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:53.987474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4281-3e3f-4f29-bd3d-edd06435136e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:53.987933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4281-3e3f-4f29-bd3d-edd06435136e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:53.988369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf4281-3e3f-4f29-bd3d-edd06435136e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:53.998847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf4281-3e3f-4f29-bd3d-edd06435136e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:54.006336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-efbf4281-3e3f-4f29-bd3d-edd06435136e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:18:54.007729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 91/186] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:18:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:18:54.013927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad4c4-427c-43d7-830a-0464c47c55ec None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.014219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad4c4-427c-43d7-830a-0464c47c55ec None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.014501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad4c4-427c-43d7-830a-0464c47c55ec None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.015928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 92/187] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:54.016504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad4c4-427c-43d7-830a-0464c47c55ec None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.024891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb666e2-a93c-436c-9f80-18619b930676 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.069442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577111b7-9b65-42d5-8444-a57763f8eb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.070355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577111b7-9b65-42d5-8444-a57763f8eb21 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.070675 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577111b7-9b65-42d5-8444-a57763f8eb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.070964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577111b7-9b65-42d5-8444-a57763f8eb21 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.071729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577111b7-9b65-42d5-8444-a57763f8eb21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:54.072042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577111b7-9b65-42d5-8444-a57763f8eb21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.073431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577111b7-9b65-42d5-8444-a57763f8eb21 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.081998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 96/188] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:54.083234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638eea-c043-4c1b-b9c1-d9ae1dbb87ad None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.083531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638eea-c043-4c1b-b9c1-d9ae1dbb87ad None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.083814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5638eea-c043-4c1b-b9c1-d9ae1dbb87ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.099725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d5638eea-c043-4c1b-b9c1-d9ae1dbb87ad None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:54.100842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d5638eea-c043-4c1b-b9c1-d9ae1dbb87ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:54.123676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad4c4-427c-43d7-830a-0464c47c55ec None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.157256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.157932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.158222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.158500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.159368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:54.159680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.161072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.166391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 97/189] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:54.167098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5638eea-c043-4c1b-b9c1-d9ae1dbb87ad None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.176750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 93/190] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:54.182288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.273519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5638eea-c043-4c1b-b9c1-d9ae1dbb87ad None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.284415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655d38-64bc-4466-a94b-00e8a85fb6ce None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.306568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e43161-7abc-4337-9a38-448c6482bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.307461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e43161-7abc-4337-9a38-448c6482bba4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.307746 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e43161-7abc-4337-9a38-448c6482bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.308022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e43161-7abc-4337-9a38-448c6482bba4 None admin] PATH_INFO: `/v3/users/5e5a2ce09aca4f078df0df982ef56281` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.319542 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643e13-009d-4b91-b356-1a5cf327091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.320478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643e13-009d-4b91-b356-1a5cf327091b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.320773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643e13-009d-4b91-b356-1a5cf327091b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.321050 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643e13-009d-4b91-b356-1a5cf327091b None admin] PATH_INFO: `/v3/users/5e5a2ce09aca4f078df0df982ef56281` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.321678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e43161-7abc-4337-9a38-448c6482bba4 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5a2ce09aca4f078df0df982ef56281)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.322262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43643e13-009d-4b91-b356-1a5cf327091b None admin] RBAC: Authorizing `identity:get_user(user_id=5e5a2ce09aca4f078df0df982ef56281)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.323189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e43161-7abc-4337-9a38-448c6482bba4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.323759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43643e13-009d-4b91-b356-1a5cf327091b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.325026 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 98/191] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/users/5e5a2ce09aca4f078df0df982ef56281 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:54.325557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 94/192] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/users/5e5a2ce09aca4f078df0df982ef56281 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:54.330379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e43161-7abc-4337-9a38-448c6482bba4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.330514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643e13-009d-4b91-b356-1a5cf327091b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.431138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643e13-009d-4b91-b356-1a5cf327091b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.431649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e43161-7abc-4337-9a38-448c6482bba4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.464521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcb2a-8e9f-4e46-8192-b99d99538867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.465179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcb2a-8e9f-4e46-8192-b99d99538867 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.465472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcb2a-8e9f-4e46-8192-b99d99538867 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.465755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dcb2a-8e9f-4e46-8192-b99d99538867 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.468738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a39619-8fcb-404c-908e-d00d137c3faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.469754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a39619-8fcb-404c-908e-d00d137c3faa None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.470274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a39619-8fcb-404c-908e-d00d137c3faa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.470799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a39619-8fcb-404c-908e-d00d137c3faa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.472182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a39619-8fcb-404c-908e-d00d137c3faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.473837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a39619-8fcb-404c-908e-d00d137c3faa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.475744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 99/193] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:54.476672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a39619-8fcb-404c-908e-d00d137c3faa None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.543574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dcb2a-8e9f-4e46-8192-b99d99538867 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.545840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561dcb2a-8e9f-4e46-8192-b99d99538867 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.577116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a39619-8fcb-404c-908e-d00d137c3faa None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.611060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd143b-86cc-4a44-a62e-e8994d9083be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.611714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd143b-86cc-4a44-a62e-e8994d9083be None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.612005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd143b-86cc-4a44-a62e-e8994d9083be None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.612288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd143b-86cc-4a44-a62e-e8994d9083be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.641546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 95/194] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:54.641546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcb2a-8e9f-4e46-8192-b99d99538867 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.683490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd143b-86cc-4a44-a62e-e8994d9083be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.685019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd143b-86cc-4a44-a62e-e8994d9083be None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.740456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561dcb2a-8e9f-4e46-8192-b99d99538867 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.772671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4988b-18ac-47ec-935c-d3f66dc71477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.773364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4988b-18ac-47ec-935c-d3f66dc71477 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.773653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4988b-18ac-47ec-935c-d3f66dc71477 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.773937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4988b-18ac-47ec-935c-d3f66dc71477 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.774701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4988b-18ac-47ec-935c-d3f66dc71477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.776151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4988b-18ac-47ec-935c-d3f66dc71477 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.785776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 100/195] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:54.785776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd143b-86cc-4a44-a62e-e8994d9083be None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.876403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd143b-86cc-4a44-a62e-e8994d9083be None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:54.893361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 96/196] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:18:54 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:54.894412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4988b-18ac-47ec-935c-d3f66dc71477 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:54.924319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c49e01-065f-47e9-98d2-41ddac8268b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:54.925764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c49e01-065f-47e9-98d2-41ddac8268b1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:54.926285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c49e01-065f-47e9-98d2-41ddac8268b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:54.926812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c49e01-065f-47e9-98d2-41ddac8268b1 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:54.928467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c49e01-065f-47e9-98d2-41ddac8268b1 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:54.930497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c49e01-065f-47e9-98d2-41ddac8268b1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:54.933171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 101/197] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:54.938621 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c49e01-065f-47e9-98d2-41ddac8268b1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:55.005662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4988b-18ac-47ec-935c-d3f66dc71477 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:55.042885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599fe75-4118-40d6-8e46-e91bc78082f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:55.043802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599fe75-4118-40d6-8e46-e91bc78082f0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:55.044104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599fe75-4118-40d6-8e46-e91bc78082f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:55.044370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599fe75-4118-40d6-8e46-e91bc78082f0 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:55.045645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599fe75-4118-40d6-8e46-e91bc78082f0 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:55.047170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599fe75-4118-40d6-8e46-e91bc78082f0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:55.048945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 97/198] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:55.055165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599fe75-4118-40d6-8e46-e91bc78082f0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:55.066103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c49e01-065f-47e9-98d2-41ddac8268b1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:55.106760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab804475-0a25-480d-9d66-9eb03788c983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:55.107687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804475-0a25-480d-9d66-9eb03788c983 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:55.108120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804475-0a25-480d-9d66-9eb03788c983 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:55.108567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab804475-0a25-480d-9d66-9eb03788c983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:55.109687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab804475-0a25-480d-9d66-9eb03788c983 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6, user.id=5e5a2ce09aca4f078df0df982ef56281) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:55.110253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab804475-0a25-480d-9d66-9eb03788c983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:55.112024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab804475-0a25-480d-9d66-9eb03788c983 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:55.118006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 102/199] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:54 2022] GET /identity/v3/role_assignments?user.id=5e5a2ce09aca4f078df0df982ef56281&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:55.174929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599fe75-4118-40d6-8e46-e91bc78082f0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:55.217228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126cf2d-2d4d-46dc-9b0d-f49bd5ccb11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:55.217848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126cf2d-2d4d-46dc-9b0d-f49bd5ccb11d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:55.218131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126cf2d-2d4d-46dc-9b0d-f49bd5ccb11d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:55.218409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126cf2d-2d4d-46dc-9b0d-f49bd5ccb11d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:55.219462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126cf2d-2d4d-46dc-9b0d-f49bd5ccb11d None admin] RBAC: Adding query filter params (role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6, user.id=5e5a2ce09aca4f078df0df982ef56281) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:55.219781 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126cf2d-2d4d-46dc-9b0d-f49bd5ccb11d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:55.221279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126cf2d-2d4d-46dc-9b0d-f49bd5ccb11d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:55.228687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 98/200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:55 2022] GET /identity/v3/role_assignments?user.id=5e5a2ce09aca4f078df0df982ef56281&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:18:55.348608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580a694-494d-4371-9937-e1b4fb85c545 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:55.348939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580a694-494d-4371-9937-e1b4fb85c545 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:55.349182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580a694-494d-4371-9937-e1b4fb85c545 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:55.351126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 103/201] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:55.357032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfdd6-bc08-4032-8ba0-49de3afc9cb7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:55.357318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfdd6-bc08-4032-8ba0-49de3afc9cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:55.357606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abfdd6-bc08-4032-8ba0-49de3afc9cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:55.379215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f1abfdd6-bc08-4032-8ba0-49de3afc9cb7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:55.380451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f1abfdd6-bc08-4032-8ba0-49de3afc9cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:55.456471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 99/202] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:55.480961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580a694-494d-4371-9937-e1b4fb85c545 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:55.617975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580a694-494d-4371-9937-e1b4fb85c545 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:55.651750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11b3fd-c2de-4d07-a83c-209f9b29269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:55.652550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b3fd-c2de-4d07-a83c-209f9b29269e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:55.652838 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b3fd-c2de-4d07-a83c-209f9b29269e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:55.653117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b3fd-c2de-4d07-a83c-209f9b29269e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:55.663760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11b3fd-c2de-4d07-a83c-209f9b29269e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:55.670722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-fc11b3fd-c2de-4d07-a83c-209f9b29269e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:18:55.672219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 104/203] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:55.683641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abfdd6-bc08-4032-8ba0-49de3afc9cb7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:55.842526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abfdd6-bc08-4032-8ba0-49de3afc9cb7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:55.887236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:55.888791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:55.889267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:55.889731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:55.890807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:55.891307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:55.892891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:55.906285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 100/204] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:55.912080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11b3fd-c2de-4d07-a83c-209f9b29269e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:56.027234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11b3fd-c2de-4d07-a83c-209f9b29269e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:56.061875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fae6-60c4-4290-92c8-435c81130bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:56.062785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fae6-60c4-4290-92c8-435c81130bea None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:56.063069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fae6-60c4-4290-92c8-435c81130bea None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:56.063341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fae6-60c4-4290-92c8-435c81130bea None admin] PATH_INFO: `/v3/users/5339f849803d41e7b6f8281f132bd38d` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:56.064561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86fae6-60c4-4290-92c8-435c81130bea None admin] RBAC: Authorizing `identity:get_user(user_id=5339f849803d41e7b6f8281f132bd38d)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:56.066032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86fae6-60c4-4290-92c8-435c81130bea None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:56.067705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 105/205] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:55 2022] GET /identity/v3/users/5339f849803d41e7b6f8281f132bd38d => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:56.073383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:56.185915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2accbf-67d0-4bab-98f0-f69469edaf5c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:56.222620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a59c9-d631-486c-99e0-59c82ec499f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:56.223554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a59c9-d631-486c-99e0-59c82ec499f9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:56.223848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a59c9-d631-486c-99e0-59c82ec499f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:56.224133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a59c9-d631-486c-99e0-59c82ec499f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:56.370943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a59c9-d631-486c-99e0-59c82ec499f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:56.372961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a59c9-d631-486c-99e0-59c82ec499f9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:56.512654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 101/206] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 16:18:56.523656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fae6-60c4-4290-92c8-435c81130bea None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:56.653878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fae6-60c4-4290-92c8-435c81130bea None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:56.694976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9636b2d-2e74-43b1-b1ef-da711ffb55ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:56.695844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9636b2d-2e74-43b1-b1ef-da711ffb55ce None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:56.696129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9636b2d-2e74-43b1-b1ef-da711ffb55ce None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:56.696408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9636b2d-2e74-43b1-b1ef-da711ffb55ce None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:56.702723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9636b2d-2e74-43b1-b1ef-da711ffb55ce None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:56.704204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9636b2d-2e74-43b1-b1ef-da711ffb55ce None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:56.705914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 106/207] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:56 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:56.711772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a59c9-d631-486c-99e0-59c82ec499f9 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:56.833521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a59c9-d631-486c-99e0-59c82ec499f9 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:56.868462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2fed4-9e11-44a1-9a84-a8274100f2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:56.869129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fed4-9e11-44a1-9a84-a8274100f2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:56.869415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fed4-9e11-44a1-9a84-a8274100f2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:56.869691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fed4-9e11-44a1-9a84-a8274100f2d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:56.870558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2fed4-9e11-44a1-9a84-a8274100f2d6 None admin] RBAC: Adding query filter params (role.id=5f2d9f744a2144228e697cda974d0a93, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f, user.id=5339f849803d41e7b6f8281f132bd38d) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:56.870885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2fed4-9e11-44a1-9a84-a8274100f2d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:56.872853 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2fed4-9e11-44a1-9a84-a8274100f2d6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:56.884685 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 102/208] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:56 2022] GET /identity/v3/role_assignments?user.id=5339f849803d41e7b6f8281f132bd38d&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=5f2d9f744a2144228e697cda974d0a93 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:57.723592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cafb3b-e1e4-4757-ad9c-1f1c5b6b0910 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:57.724093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cafb3b-e1e4-4757-ad9c-1f1c5b6b0910 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:57.724192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cafb3b-e1e4-4757-ad9c-1f1c5b6b0910 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:57.725524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 107/209] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:57.732328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ba63-c302-40f9-9141-6c1215d6c5e3 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:57.733103 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ba63-c302-40f9-9141-6c1215d6c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:57.733613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ba63-c302-40f9-9141-6c1215d6c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:57.750382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f939ba63-c302-40f9-9141-6c1215d6c5e3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:57.751952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f939ba63-c302-40f9-9141-6c1215d6c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:57.792984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dc55-4642-4283-bf43-3955b7a67e88 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:57.793298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dc55-4642-4283-bf43-3955b7a67e88 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:57.793545 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dc55-4642-4283-bf43-3955b7a67e88 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:57.795753 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 108/210] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:18:57.803269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090544-8c8d-451c-99f3-a8ea44b61911 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:57.804009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090544-8c8d-451c-99f3-a8ea44b61911 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:57.804354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11090544-8c8d-451c-99f3-a8ea44b61911 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:57.805973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 109/211] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:57.808082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14f34-7a12-4f89-8e20-d8623d1d07a5 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:57.808442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14f34-7a12-4f89-8e20-d8623d1d07a5 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:57.808795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14f34-7a12-4f89-8e20-d8623d1d07a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:57.824095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 103/212] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:57.825769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106277b-45c8-4e4c-84d4-5da201d58bca None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:57.826060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106277b-45c8-4e4c-84d4-5da201d58bca None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:57.826338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106277b-45c8-4e4c-84d4-5da201d58bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:57.831420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-32f14f34-7a12-4f89-8e20-d8623d1d07a5 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:57.832640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-32f14f34-7a12-4f89-8e20-d8623d1d07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:57.847047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7106277b-45c8-4e4c-84d4-5da201d58bca None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:57.848241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7106277b-45c8-4e4c-84d4-5da201d58bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:57.901317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 110/213] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:18:57.910769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14f34-7a12-4f89-8e20-d8623d1d07a5 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:57.919703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 104/214] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:57.931809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106277b-45c8-4e4c-84d4-5da201d58bca None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.002635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14f34-7a12-4f89-8e20-d8623d1d07a5 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.032797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106277b-45c8-4e4c-84d4-5da201d58bca None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.046506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169719-6a15-4574-8482-33266f2955a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.047931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169719-6a15-4574-8482-33266f2955a5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.048229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169719-6a15-4574-8482-33266f2955a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.048515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169719-6a15-4574-8482-33266f2955a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.059650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b169719-6a15-4574-8482-33266f2955a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:58.066895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-6b169719-6a15-4574-8482-33266f2955a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:18:58.072712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 111/215] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:58.072712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169719-6a15-4574-8482-33266f2955a5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.077305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ef341-24df-4fd4-9b25-9e37b818d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.078116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef341-24df-4fd4-9b25-9e37b818d240 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.078406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef341-24df-4fd4-9b25-9e37b818d240 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.078719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef341-24df-4fd4-9b25-9e37b818d240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.090055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ef341-24df-4fd4-9b25-9e37b818d240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:58.099344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-f46ef341-24df-4fd4-9b25-9e37b818d240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:18:58.106084 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 105/216] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:18:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:58.106084 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ef341-24df-4fd4-9b25-9e37b818d240 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.169734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169719-6a15-4574-8482-33266f2955a5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.202810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac769a5-1e8e-4030-96bc-46a16e508ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.203240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ef341-24df-4fd4-9b25-9e37b818d240 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.203614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac769a5-1e8e-4030-96bc-46a16e508ead None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.203903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac769a5-1e8e-4030-96bc-46a16e508ead None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.204188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac769a5-1e8e-4030-96bc-46a16e508ead None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.205374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac769a5-1e8e-4030-96bc-46a16e508ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:58.206863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac769a5-1e8e-4030-96bc-46a16e508ead None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:58.213632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 112/217] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:58.213632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac769a5-1e8e-4030-96bc-46a16e508ead None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.236198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882f539-bd25-4735-bd91-c41073a7d599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.236863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f539-bd25-4735-bd91-c41073a7d599 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.245512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f539-bd25-4735-bd91-c41073a7d599 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.245512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f539-bd25-4735-bd91-c41073a7d599 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.245512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f539-bd25-4735-bd91-c41073a7d599 None admin] RBAC: Adding query filter params (name=member) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:58.245512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f539-bd25-4735-bd91-c41073a7d599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:58.245512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882f539-bd25-4735-bd91-c41073a7d599 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:58.248268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 106/218] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:58.249269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b64f-cdfa-4cfd-ba19-676e8d3ba018 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.249556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b64f-cdfa-4cfd-ba19-676e8d3ba018 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.249831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97b64f-cdfa-4cfd-ba19-676e8d3ba018 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.251208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 107/219] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:18:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:18:58.251750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b64f-cdfa-4cfd-ba19-676e8d3ba018 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.313796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac769a5-1e8e-4030-96bc-46a16e508ead None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.345602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.346224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97b64f-cdfa-4cfd-ba19-676e8d3ba018 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.346322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.346571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.346849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.347603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:58.347915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:58.349309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:58.357646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 113/220] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:58.358416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.378163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019be757-5bbd-4db3-ac9f-9f1e0bc684c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.378864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be757-5bbd-4db3-ac9f-9f1e0bc684c9 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.379148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be757-5bbd-4db3-ac9f-9f1e0bc684c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.379422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019be757-5bbd-4db3-ac9f-9f1e0bc684c9 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.380160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019be757-5bbd-4db3-ac9f-9f1e0bc684c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:58.381593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019be757-5bbd-4db3-ac9f-9f1e0bc684c9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:58.455207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb07d-b802-4906-aa3c-7b58172d799c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.455926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 108/221] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:18:58 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:18:58.457198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8137fbe-5609-49b9-9388-7377d2947456 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.457492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8137fbe-5609-49b9-9388-7377d2947456 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.457984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8137fbe-5609-49b9-9388-7377d2947456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.476945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-a8137fbe-5609-49b9-9388-7377d2947456 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:18:58.478177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a8137fbe-5609-49b9-9388-7377d2947456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:18:58.492719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277917-4c9e-4683-9f35-37c33e0467ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.493651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277917-4c9e-4683-9f35-37c33e0467ec None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.493939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277917-4c9e-4683-9f35-37c33e0467ec None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.494217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95277917-4c9e-4683-9f35-37c33e0467ec None admin] PATH_INFO: `/v3/users/adc032366c62403eae883fd06f60561d` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.508633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95277917-4c9e-4683-9f35-37c33e0467ec None admin] RBAC: Authorizing `identity:get_user(user_id=adc032366c62403eae883fd06f60561d)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:58.510169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95277917-4c9e-4683-9f35-37c33e0467ec None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:58.512210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 114/222] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/users/adc032366c62403eae883fd06f60561d => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:58.515627 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277917-4c9e-4683-9f35-37c33e0467ec None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.554081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 109/223] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:18:58.554909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8137fbe-5609-49b9-9388-7377d2947456 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.632196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95277917-4c9e-4683-9f35-37c33e0467ec None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.659509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8137fbe-5609-49b9-9388-7377d2947456 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.669303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6c34-74ae-4642-89b5-064ace2b22cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.670187 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6c34-74ae-4642-89b5-064ace2b22cc None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.670477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6c34-74ae-4642-89b5-064ace2b22cc None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.671419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6c34-74ae-4642-89b5-064ace2b22cc None admin] PATH_INFO: `/v3/users/5e5a2ce09aca4f078df0df982ef56281` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.672034 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e6c34-74ae-4642-89b5-064ace2b22cc None admin] RBAC: Authorizing `identity:get_user(user_id=5e5a2ce09aca4f078df0df982ef56281)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:58.673501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e6c34-74ae-4642-89b5-064ace2b22cc None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:58.676770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 115/224] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/users/5e5a2ce09aca4f078df0df982ef56281 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:58.676770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6c34-74ae-4642-89b5-064ace2b22cc None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.703736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b6f9b-817d-4812-86b6-c96d9a66372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.704405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b6f9b-817d-4812-86b6-c96d9a66372a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.704691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b6f9b-817d-4812-86b6-c96d9a66372a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.704972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b6f9b-817d-4812-86b6-c96d9a66372a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.782206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b6f9b-817d-4812-86b6-c96d9a66372a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:58.782857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6c34-74ae-4642-89b5-064ace2b22cc None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.783718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b6f9b-817d-4812-86b6-c96d9a66372a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:58.818767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195fe32-5ed7-4fb2-ac2b-40de5451af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:58.819944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195fe32-5ed7-4fb2-ac2b-40de5451af5d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:58.820489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195fe32-5ed7-4fb2-ac2b-40de5451af5d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:58.820988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195fe32-5ed7-4fb2-ac2b-40de5451af5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:58.833609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195fe32-5ed7-4fb2-ac2b-40de5451af5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:18:58.842129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-8195fe32-5ed7-4fb2-ac2b-40de5451af5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:18:58.844127 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 116/225] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:18:58.845100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195fe32-5ed7-4fb2-ac2b-40de5451af5d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.885151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 110/226] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:18:58.890623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b6f9b-817d-4812-86b6-c96d9a66372a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:58.969104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195fe32-5ed7-4fb2-ac2b-40de5451af5d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:58.991605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b6f9b-817d-4812-86b6-c96d9a66372a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:59.013493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c298cfc-50f9-47e2-a4d1-ba5a2743a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:59.014891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c298cfc-50f9-47e2-a4d1-ba5a2743a987 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:59.015640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c298cfc-50f9-47e2-a4d1-ba5a2743a987 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:59.016364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c298cfc-50f9-47e2-a4d1-ba5a2743a987 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:59.017903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c298cfc-50f9-47e2-a4d1-ba5a2743a987 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:59.020295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c298cfc-50f9-47e2-a4d1-ba5a2743a987 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:59.022887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 117/227] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:59.023785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c298cfc-50f9-47e2-a4d1-ba5a2743a987 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:59.029009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:59.029691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:59.029977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:59.030256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:59.031052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:59.031361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:59.032739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:59.041203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 111/228] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:18:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:59.041841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:59.132593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c298cfc-50f9-47e2-a4d1-ba5a2743a987 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:59.144609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f87fe9-6f06-4d0f-817c-41e166f377f6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:59.166586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bccad-cef9-4b78-a8bc-93945b8fdda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:59.167854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bccad-cef9-4b78-a8bc-93945b8fdda8 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:59.168332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bccad-cef9-4b78-a8bc-93945b8fdda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:59.168799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bccad-cef9-4b78-a8bc-93945b8fdda8 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:59.170282 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bccad-cef9-4b78-a8bc-93945b8fdda8 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:59.171975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bccad-cef9-4b78-a8bc-93945b8fdda8 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:59.173856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 118/229] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:59 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:59.174864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bccad-cef9-4b78-a8bc-93945b8fdda8 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:59.181797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57ffa8-af81-47d4-9418-0b59799d7714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:59.182738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57ffa8-af81-47d4-9418-0b59799d7714 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:59.183049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57ffa8-af81-47d4-9418-0b59799d7714 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:59.183313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57ffa8-af81-47d4-9418-0b59799d7714 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/users/5e5a2ce09aca4f078df0df982ef56281/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:59.185835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57ffa8-af81-47d4-9418-0b59799d7714 None admin] RBAC: Authorizing `identity:create_grant(project_id=06dd0f86b47846d2aa207c0f5574fbd6, user_id=5e5a2ce09aca4f078df0df982ef56281, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:59.187297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57ffa8-af81-47d4-9418-0b59799d7714 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:59.278560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 112/230] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:18:59 2022] PUT /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/users/5e5a2ce09aca4f078df0df982ef56281/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:18:59.278560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57ffa8-af81-47d4-9418-0b59799d7714 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:59.300247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bccad-cef9-4b78-a8bc-93945b8fdda8 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:59.375884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f468a67-d6e5-4f28-90f6-c3ee42a15209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:59.376780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f468a67-d6e5-4f28-90f6-c3ee42a15209 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:59.377124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f468a67-d6e5-4f28-90f6-c3ee42a15209 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:59.377410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f468a67-d6e5-4f28-90f6-c3ee42a15209 None admin] PATH_INFO: `/v3/users/5e5a2ce09aca4f078df0df982ef56281` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:59.380989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f468a67-d6e5-4f28-90f6-c3ee42a15209 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5a2ce09aca4f078df0df982ef56281)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:59.382569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f468a67-d6e5-4f28-90f6-c3ee42a15209 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:59.385704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 119/231] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:18:59 2022] GET /identity/v3/users/5e5a2ce09aca4f078df0df982ef56281 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:59.392705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f468a67-d6e5-4f28-90f6-c3ee42a15209 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:59.445036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57ffa8-af81-47d4-9418-0b59799d7714 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:59.510930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:59.511936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:59.512415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:59.513587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:59.514684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] RBAC: Adding query filter params (role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6, user.id=adc032366c62403eae883fd06f60561d) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:18:59.515194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:59.516829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:59.522721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 113/232] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:18:59 2022] GET /identity/v3/role_assignments?user.id=adc032366c62403eae883fd06f60561d&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:59.543307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f468a67-d6e5-4f28-90f6-c3ee42a15209 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:59.584773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c352a08-1fd3-46c0-8422-88e43b33c18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:59.585677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352a08-1fd3-46c0-8422-88e43b33c18e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:59.585963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352a08-1fd3-46c0-8422-88e43b33c18e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:59.586244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352a08-1fd3-46c0-8422-88e43b33c18e None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:59.587535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c352a08-1fd3-46c0-8422-88e43b33c18e None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:59.589013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c352a08-1fd3-46c0-8422-88e43b33c18e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:59.591199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 120/233] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:18:59 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:18:59.596851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:18:59.707843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc81cca-4997-4519-8dca-0206693fc04c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:18:59.742593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a7574-52fa-4729-a501-07d822065bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:18:59.743511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7574-52fa-4729-a501-07d822065bb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:18:59.743801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7574-52fa-4729-a501-07d822065bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:18:59.744082 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a7574-52fa-4729-a501-07d822065bb5 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/users/5e5a2ce09aca4f078df0df982ef56281/roles/caa40465e0b0487aa66fec9cda30ce92` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:18:59.746355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a7574-52fa-4729-a501-07d822065bb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=06dd0f86b47846d2aa207c0f5574fbd6, user_id=5e5a2ce09aca4f078df0df982ef56281, role_id=caa40465e0b0487aa66fec9cda30ce92)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:18:59.748417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a7574-52fa-4729-a501-07d822065bb5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:18:59.843493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 114/234] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:18:59 2022] PUT /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/users/5e5a2ce09aca4f078df0df982ef56281/roles/caa40465e0b0487aa66fec9cda30ce92 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:01.141057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ee7e-a497-4a22-9fe8-3cfdbd3cd640 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.141586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ee7e-a497-4a22-9fe8-3cfdbd3cd640 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.141586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ee7e-a497-4a22-9fe8-3cfdbd3cd640 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:01.143304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 121/235] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:01.153073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0842-9361-4cdf-8d8c-1321f7508350 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.154467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0842-9361-4cdf-8d8c-1321f7508350 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.154978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0842-9361-4cdf-8d8c-1321f7508350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:01.175953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5d7b0842-9361-4cdf-8d8c-1321f7508350 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:01.177451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5d7b0842-9361-4cdf-8d8c-1321f7508350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:01.213726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0213c-3749-4ed3-adf5-6c7db06882b1 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.214336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0213c-3749-4ed3-adf5-6c7db06882b1 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.214846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0213c-3749-4ed3-adf5-6c7db06882b1 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:01.217264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 122/236] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:01.222363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1316a-c337-4419-a64c-97681c558ecc None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.222909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1316a-c337-4419-a64c-97681c558ecc None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.223589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1316a-c337-4419-a64c-97681c558ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:01.240520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-18b1316a-c337-4419-a64c-97681c558ecc None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:01.242073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-18b1316a-c337-4419-a64c-97681c558ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:01.273405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 115/237] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:01.306259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b0842-9361-4cdf-8d8c-1321f7508350 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:01.311720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 123/238] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:01.336021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1316a-c337-4419-a64c-97681c558ecc None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:01.435129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1316a-c337-4419-a64c-97681c558ecc None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:01.471736 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81f96-67b3-4a66-89be-78959ba0e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:01.473260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81f96-67b3-4a66-89be-78959ba0e57f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.473744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81f96-67b3-4a66-89be-78959ba0e57f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.474215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81f96-67b3-4a66-89be-78959ba0e57f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:01.475943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81f96-67b3-4a66-89be-78959ba0e57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:01.477875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81f96-67b3-4a66-89be-78959ba0e57f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:01.480029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 124/239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:01.486255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81f96-67b3-4a66-89be-78959ba0e57f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:01.522414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b0842-9361-4cdf-8d8c-1321f7508350 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:01.584621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f887a-8162-40e5-87e0-6e13c96ac6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:01.585436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f887a-8162-40e5-87e0-6e13c96ac6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.585730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f887a-8162-40e5-87e0-6e13c96ac6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.586015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f887a-8162-40e5-87e0-6e13c96ac6f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:01.587428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81f96-67b3-4a66-89be-78959ba0e57f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:01.602966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f887a-8162-40e5-87e0-6e13c96ac6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:01.618337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-ae3f887a-8162-40e5-87e0-6e13c96ac6f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:19:01.620644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 116/240] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:01.620754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690c51f-1573-4b32-a74a-d82fc03696d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:01.621356 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c51f-1573-4b32-a74a-d82fc03696d0 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.621797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c51f-1573-4b32-a74a-d82fc03696d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.622771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690c51f-1573-4b32-a74a-d82fc03696d0 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:01.623619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690c51f-1573-4b32-a74a-d82fc03696d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:01.625202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690c51f-1573-4b32-a74a-d82fc03696d0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:01.626431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f887a-8162-40e5-87e0-6e13c96ac6f5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:01.715005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 125/241] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:19:01 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:19:01.749101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f887a-8162-40e5-87e0-6e13c96ac6f5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:01.788507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:01.789430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.789885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.790303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:01.791262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:01.791719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:01.793366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:01.804052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 117/242] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:01.811929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690c51f-1573-4b32-a74a-d82fc03696d0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:01.945894 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690c51f-1573-4b32-a74a-d82fc03696d0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:01.986906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9594c-1d94-4372-bb11-9025cbfed0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:01.988025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9594c-1d94-4372-bb11-9025cbfed0eb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:01.988472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9594c-1d94-4372-bb11-9025cbfed0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:01.988897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9594c-1d94-4372-bb11-9025cbfed0eb None admin] PATH_INFO: `/v3/users/07a8216bbc3f495ca020e85ef1f3ec28` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.011697 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9594c-1d94-4372-bb11-9025cbfed0eb None admin] RBAC: Authorizing `identity:get_user(user_id=07a8216bbc3f495ca020e85ef1f3ec28)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:02.013539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9594c-1d94-4372-bb11-9025cbfed0eb None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:02.015848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 126/243] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:01 2022] GET /identity/v3/users/07a8216bbc3f495ca020e85ef1f3ec28 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:02.021267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:02.134240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7d2a0-9839-401f-92e9-5bfb9ba3238b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:02.173112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5c852-ffda-4310-bf6a-d86a775e2fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:02.174436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c852-ffda-4310-bf6a-d86a775e2fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.174902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c852-ffda-4310-bf6a-d86a775e2fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.175320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c852-ffda-4310-bf6a-d86a775e2fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.244965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5c852-ffda-4310-bf6a-d86a775e2fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:02.246385 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5c852-ffda-4310-bf6a-d86a775e2fe8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:02.256664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5567-8f89-4b90-a51d-9f00efa39343 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.257169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5567-8f89-4b90-a51d-9f00efa39343 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.257374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f5567-8f89-4b90-a51d-9f00efa39343 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.258987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 127/244] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:02.261253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb20d9-5757-48c0-b966-192d2efbbb1e None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.261730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb20d9-5757-48c0-b966-192d2efbbb1e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.262157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb20d9-5757-48c0-b966-192d2efbbb1e None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.263946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 128/245] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:02.265428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80226585-f5bf-4fb5-aa54-18ffda6f612f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.265808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80226585-f5bf-4fb5-aa54-18ffda6f612f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.266404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80226585-f5bf-4fb5-aa54-18ffda6f612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.286406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-80226585-f5bf-4fb5-aa54-18ffda6f612f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:02.287877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-80226585-f5bf-4fb5-aa54-18ffda6f612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:02.362769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 129/246] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:02.363105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 118/247] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:02.363855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d8bd-1637-442f-bab7-af26c5323454 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.364147 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d8bd-1637-442f-bab7-af26c5323454 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.364427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4d8bd-1637-442f-bab7-af26c5323454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.368508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5c852-ffda-4310-bf6a-d86a775e2fe8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:02.382315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ebf4d8bd-1637-442f-bab7-af26c5323454 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:02.383603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ebf4d8bd-1637-442f-bab7-af26c5323454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:02.471099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 130/248] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:02.471099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4d8bd-1637-442f-bab7-af26c5323454 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:02.486073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5c852-ffda-4310-bf6a-d86a775e2fe8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:02.541483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158f217-da2f-47e3-954a-cbea9bbba2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:02.544396 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f217-da2f-47e3-954a-cbea9bbba2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.544912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f217-da2f-47e3-954a-cbea9bbba2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.546400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158f217-da2f-47e3-954a-cbea9bbba2b8 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.548539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158f217-da2f-47e3-954a-cbea9bbba2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:02.556810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158f217-da2f-47e3-954a-cbea9bbba2b8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:02.558220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 119/249] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:02 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:02.559030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158f217-da2f-47e3-954a-cbea9bbba2b8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:02.587811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4d8bd-1637-442f-bab7-af26c5323454 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:02.627332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c369-a5fb-4b29-9813-7e5d9e391bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:02.629278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c369-a5fb-4b29-9813-7e5d9e391bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.629985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c369-a5fb-4b29-9813-7e5d9e391bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.630678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c369-a5fb-4b29-9813-7e5d9e391bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.655523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84c369-a5fb-4b29-9813-7e5d9e391bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:02.667323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-9b84c369-a5fb-4b29-9813-7e5d9e391bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:19:02.670130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 131/250] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:02.672596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c369-a5fb-4b29-9813-7e5d9e391bc5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:02.744389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158f217-da2f-47e3-954a-cbea9bbba2b8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:02.780313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84c369-a5fb-4b29-9813-7e5d9e391bc5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:02.788115 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f973-fbf0-4740-bfea-a0f2a34bf200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:02.788926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f973-fbf0-4740-bfea-a0f2a34bf200 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.789210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f973-fbf0-4740-bfea-a0f2a34bf200 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.789482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603f973-fbf0-4740-bfea-a0f2a34bf200 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.811978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603f973-fbf0-4740-bfea-a0f2a34bf200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:02.816805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:02.817718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.818226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.818750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.819796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] RBAC: Adding query filter params (role.id=5f2d9f744a2144228e697cda974d0a93, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6, user.id=07a8216bbc3f495ca020e85ef1f3ec28) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:02.820313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:02.821994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:02.827183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-2603f973-fbf0-4740-bfea-a0f2a34bf200 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:02.828434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 132/251] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:02 2022] GET /identity/v3/role_assignments?user.id=07a8216bbc3f495ca020e85ef1f3ec28&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=5f2d9f744a2144228e697cda974d0a93 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:02.833352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 120/252] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:02.833352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f973-fbf0-4740-bfea-a0f2a34bf200 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:02.835309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:02.951326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603f973-fbf0-4740-bfea-a0f2a34bf200 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:02.965040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0b681-1f6c-41f8-b665-06dc38ffa43f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:02.991223 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a053a-514a-4fb4-b6ae-421866552ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:02.992760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a053a-514a-4fb4-b6ae-421866552ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:02.993476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a053a-514a-4fb4-b6ae-421866552ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:02.993939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a053a-514a-4fb4-b6ae-421866552ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:02.995093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a053a-514a-4fb4-b6ae-421866552ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:02.995589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a053a-514a-4fb4-b6ae-421866552ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:02.998081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a053a-514a-4fb4-b6ae-421866552ff7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:03.008167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 121/253] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:03.010080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3f098-cc7c-4cb0-a243-10aef667b5d0 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.010620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3f098-cc7c-4cb0-a243-10aef667b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.011489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3f098-cc7c-4cb0-a243-10aef667b5d0 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.013372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 122/254] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:03.014513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3f098-cc7c-4cb0-a243-10aef667b5d0 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:03.047513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7610932-e379-488a-b980-7116860d6953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:03.048113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610932-e379-488a-b980-7116860d6953 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.048395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610932-e379-488a-b980-7116860d6953 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.048673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610932-e379-488a-b980-7116860d6953 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.049500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7610932-e379-488a-b980-7116860d6953 None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:03.049752 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7610932-e379-488a-b980-7116860d6953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:03.051184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7610932-e379-488a-b980-7116860d6953 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:03.080640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 133/255] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:03.080640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868e2d-1dcf-4849-bb8e-e081344cbd97 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.080640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868e2d-1dcf-4849-bb8e-e081344cbd97 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.080640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868e2d-1dcf-4849-bb8e-e081344cbd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.118703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4b868e2d-1dcf-4849-bb8e-e081344cbd97 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:03.119917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4b868e2d-1dcf-4849-bb8e-e081344cbd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:03.143560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3f098-cc7c-4cb0-a243-10aef667b5d0 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:03.184885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11d6b3-a267-4aa4-9758-e1d4ae8e3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:03.186838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11d6b3-a267-4aa4-9758-e1d4ae8e3859 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.187275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11d6b3-a267-4aa4-9758-e1d4ae8e3859 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.187699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11d6b3-a267-4aa4-9758-e1d4ae8e3859 None admin] PATH_INFO: `/v3/users/5e5a2ce09aca4f078df0df982ef56281` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.189228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11d6b3-a267-4aa4-9758-e1d4ae8e3859 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5a2ce09aca4f078df0df982ef56281)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:03.194425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11d6b3-a267-4aa4-9758-e1d4ae8e3859 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:03.194425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 123/256] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:03 2022] GET /identity/v3/users/5e5a2ce09aca4f078df0df982ef56281 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:03.194425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11d6b3-a267-4aa4-9758-e1d4ae8e3859 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:03.249419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 134/257] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:03.250314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b868e2d-1dcf-4849-bb8e-e081344cbd97 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:03.366697 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11d6b3-a267-4aa4-9758-e1d4ae8e3859 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:03.379278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b868e2d-1dcf-4849-bb8e-e081344cbd97 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:03.428410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7aeb3-58fd-4514-bc54-3009bf797ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:03.429563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7aeb3-58fd-4514-bc54-3009bf797ebb None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.429849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7aeb3-58fd-4514-bc54-3009bf797ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.430131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7aeb3-58fd-4514-bc54-3009bf797ebb None admin] PATH_INFO: `/v3/users/adc032366c62403eae883fd06f60561d` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.433159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7aeb3-58fd-4514-bc54-3009bf797ebb None admin] RBAC: Authorizing `identity:get_user(user_id=adc032366c62403eae883fd06f60561d)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:03.434678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7aeb3-58fd-4514-bc54-3009bf797ebb None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:03.436359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 124/258] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:03 2022] GET /identity/v3/users/adc032366c62403eae883fd06f60561d => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:03.437134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7aeb3-58fd-4514-bc54-3009bf797ebb None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:03.451299 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b15ac-50da-4fb7-a923-f02fb3597e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:03.451972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b15ac-50da-4fb7-a923-f02fb3597e9a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.452262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b15ac-50da-4fb7-a923-f02fb3597e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.452543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b15ac-50da-4fb7-a923-f02fb3597e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.553786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b15ac-50da-4fb7-a923-f02fb3597e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:03.555305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b15ac-50da-4fb7-a923-f02fb3597e9a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:03.642896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7aeb3-58fd-4514-bc54-3009bf797ebb None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:03.656665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 135/259] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:03.657847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b15ac-50da-4fb7-a923-f02fb3597e9a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:03.723234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55448c1-0720-4005-9656-d2876def3a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:03.724322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55448c1-0720-4005-9656-d2876def3a20 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.724759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55448c1-0720-4005-9656-d2876def3a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.725185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55448c1-0720-4005-9656-d2876def3a20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.739284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55448c1-0720-4005-9656-d2876def3a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:03.755173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a55448c1-0720-4005-9656-d2876def3a20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:19:03.756261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b15ac-50da-4fb7-a923-f02fb3597e9a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:03.756611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 125/260] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:19:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:03.757476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55448c1-0720-4005-9656-d2876def3a20 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:03.796859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a2e6-6f9a-4f36-b600-fa20f2178859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:03.798115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a2e6-6f9a-4f36-b600-fa20f2178859 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.798652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a2e6-6f9a-4f36-b600-fa20f2178859 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.799143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57a2e6-6f9a-4f36-b600-fa20f2178859 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.801426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57a2e6-6f9a-4f36-b600-fa20f2178859 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:03.803125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57a2e6-6f9a-4f36-b600-fa20f2178859 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:03.805435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 136/261] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:03 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:03.807466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a2e6-6f9a-4f36-b600-fa20f2178859 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:03.923425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55448c1-0720-4005-9656-d2876def3a20 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:03.926038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57a2e6-6f9a-4f36-b600-fa20f2178859 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:03.958232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ce7f-583c-42bd-ad5f-405e9843e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:03.959139 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ce7f-583c-42bd-ad5f-405e9843e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.959428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ce7f-583c-42bd-ad5f-405e9843e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.959709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ce7f-583c-42bd-ad5f-405e9843e4e2 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.967308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65ce7f-583c-42bd-ad5f-405e9843e4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:03.968782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65ce7f-583c-42bd-ad5f-405e9843e4e2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:03.971339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164934c-22aa-4938-b445-7728771975ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:03.972019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164934c-22aa-4938-b445-7728771975ae None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:03.972306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164934c-22aa-4938-b445-7728771975ae None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:03.972588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164934c-22aa-4938-b445-7728771975ae None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:03.973353 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164934c-22aa-4938-b445-7728771975ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:03.973666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164934c-22aa-4938-b445-7728771975ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:03.975081 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164934c-22aa-4938-b445-7728771975ae None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:03.976465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 126/262] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:03 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:03.977167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ce7f-583c-42bd-ad5f-405e9843e4e2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:03.996645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 137/263] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:03.998776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164934c-22aa-4938-b445-7728771975ae None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:04.095826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ce7f-583c-42bd-ad5f-405e9843e4e2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:04.133381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0dbfd-9e6d-4488-bb89-c20b3f70b459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:04.134294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0dbfd-9e6d-4488-bb89-c20b3f70b459 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:04.134600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0dbfd-9e6d-4488-bb89-c20b3f70b459 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:04.134888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0dbfd-9e6d-4488-bb89-c20b3f70b459 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/users/adc032366c62403eae883fd06f60561d/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:04.137683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0dbfd-9e6d-4488-bb89-c20b3f70b459 None admin] RBAC: Authorizing `identity:create_grant(project_id=06dd0f86b47846d2aa207c0f5574fbd6, user_id=adc032366c62403eae883fd06f60561d, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:04.139676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0dbfd-9e6d-4488-bb89-c20b3f70b459 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:04.183999 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164934c-22aa-4938-b445-7728771975ae None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:04.216643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 127/264] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:19:03 2022] PUT /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/users/adc032366c62403eae883fd06f60561d/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:04.218187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0dbfd-9e6d-4488-bb89-c20b3f70b459 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:04.226288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:04.227564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:04.227564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:04.227762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:04.234725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6, user.id=5e5a2ce09aca4f078df0df982ef56281) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:04.234725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:04.234725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:04.241522 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 138/265] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:03 2022] GET /identity/v3/role_assignments?user.id=5e5a2ce09aca4f078df0df982ef56281&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:04.379876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0dbfd-9e6d-4488-bb89-c20b3f70b459 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:04.423919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b761407-5d9a-4910-b9a1-4952bde76033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:04.425185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b761407-5d9a-4910-b9a1-4952bde76033 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:04.425673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b761407-5d9a-4910-b9a1-4952bde76033 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:04.426171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b761407-5d9a-4910-b9a1-4952bde76033 None admin] PATH_INFO: `/v3/users/5e5a2ce09aca4f078df0df982ef56281` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:04.427684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b761407-5d9a-4910-b9a1-4952bde76033 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5a2ce09aca4f078df0df982ef56281)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:04.429632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b761407-5d9a-4910-b9a1-4952bde76033 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:04.432009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 128/266] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:04 2022] GET /identity/v3/users/5e5a2ce09aca4f078df0df982ef56281 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:04.437924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:04.615604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8285-f8f3-467e-a44d-3b51a1ae3304 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:04.664662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20ef44-18bd-4d44-a752-0adfc4f57179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:04.665326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20ef44-18bd-4d44-a752-0adfc4f57179 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:04.665612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20ef44-18bd-4d44-a752-0adfc4f57179 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:04.665886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20ef44-18bd-4d44-a752-0adfc4f57179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:04.747130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23388e9-06c3-40d1-9e23-6739a61c0d48 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:04.747415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23388e9-06c3-40d1-9e23-6739a61c0d48 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:04.747510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20ef44-18bd-4d44-a752-0adfc4f57179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:04.747676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23388e9-06c3-40d1-9e23-6739a61c0d48 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:04.749011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20ef44-18bd-4d44-a752-0adfc4f57179 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:04.749274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 129/267] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:04.754506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185535b-7d2a-4d18-a983-0656cfc7962a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:04.754826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185535b-7d2a-4d18-a983-0656cfc7962a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:04.755285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185535b-7d2a-4d18-a983-0656cfc7962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:04.794755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-a185535b-7d2a-4d18-a983-0656cfc7962a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:04.795968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a185535b-7d2a-4d18-a983-0656cfc7962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:04.866244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 139/268] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:04.872063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20ef44-18bd-4d44-a752-0adfc4f57179 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:04.938063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 130/269] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:04.983535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185535b-7d2a-4d18-a983-0656cfc7962a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:05.033946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20ef44-18bd-4d44-a752-0adfc4f57179 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:05.092919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75436c75-6921-4a3f-abdf-2743bdd3d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:05.094119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75436c75-6921-4a3f-abdf-2743bdd3d786 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.094605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75436c75-6921-4a3f-abdf-2743bdd3d786 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.095065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75436c75-6921-4a3f-abdf-2743bdd3d786 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.099263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75436c75-6921-4a3f-abdf-2743bdd3d786 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:05.101057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75436c75-6921-4a3f-abdf-2743bdd3d786 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:05.103021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 140/270] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:04 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:05.121215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75436c75-6921-4a3f-abdf-2743bdd3d786 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:05.128027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185535b-7d2a-4d18-a983-0656cfc7962a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:05.167430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6280cf-60d8-4f08-89c4-f3ccbed89917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:05.168245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6280cf-60d8-4f08-89c4-f3ccbed89917 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.168528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6280cf-60d8-4f08-89c4-f3ccbed89917 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.168826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6280cf-60d8-4f08-89c4-f3ccbed89917 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.170075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6280cf-60d8-4f08-89c4-f3ccbed89917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:05.171600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6280cf-60d8-4f08-89c4-f3ccbed89917 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:05.173525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 131/271] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:05.183660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6280cf-60d8-4f08-89c4-f3ccbed89917 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:05.256454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75436c75-6921-4a3f-abdf-2743bdd3d786 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:05.294297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92288bd-c54d-4ea7-8fea-a5b8b4dcc85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:05.294904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92288bd-c54d-4ea7-8fea-a5b8b4dcc85b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.295188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92288bd-c54d-4ea7-8fea-a5b8b4dcc85b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.295464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92288bd-c54d-4ea7-8fea-a5b8b4dcc85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.296299 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92288bd-c54d-4ea7-8fea-a5b8b4dcc85b None admin] RBAC: Adding query filter params (role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6, user.id=5e5a2ce09aca4f078df0df982ef56281) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:05.296678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92288bd-c54d-4ea7-8fea-a5b8b4dcc85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:05.298120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92288bd-c54d-4ea7-8fea-a5b8b4dcc85b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:05.304350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 141/272] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:05 2022] GET /identity/v3/role_assignments?user.id=5e5a2ce09aca4f078df0df982ef56281&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:05.310656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273846-f5de-43ba-b61a-30e6fa3abb3e None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.310656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273846-f5de-43ba-b61a-30e6fa3abb3e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.310656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273846-f5de-43ba-b61a-30e6fa3abb3e None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.310656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 142/273] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:05.316219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f25268-1659-4519-b0e1-3e3259f6a4d6 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.316532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f25268-1659-4519-b0e1-3e3259f6a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.316795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f25268-1659-4519-b0e1-3e3259f6a4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.346121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d4f25268-1659-4519-b0e1-3e3259f6a4d6 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:05.347510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d4f25268-1659-4519-b0e1-3e3259f6a4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:05.382438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6280cf-60d8-4f08-89c4-f3ccbed89917 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:05.448685 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac57e7-2b14-4eb0-81f7-9500991ceeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:05.449384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac57e7-2b14-4eb0-81f7-9500991ceeb6 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.449670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac57e7-2b14-4eb0-81f7-9500991ceeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.449950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac57e7-2b14-4eb0-81f7-9500991ceeb6 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.451282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac57e7-2b14-4eb0-81f7-9500991ceeb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:05.456977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac57e7-2b14-4eb0-81f7-9500991ceeb6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:05.490672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 143/274] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:05.515861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f25268-1659-4519-b0e1-3e3259f6a4d6 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:05.548045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 132/275] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:19:05 2022] POST /identity/v3/users => generated 293 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:19:05.630093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f25268-1659-4519-b0e1-3e3259f6a4d6 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:05.673474 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030b66-7b38-49a0-b285-1328983b98c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:05.674323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030b66-7b38-49a0-b285-1328983b98c9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.674696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030b66-7b38-49a0-b285-1328983b98c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.674995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6030b66-7b38-49a0-b285-1328983b98c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.689098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6030b66-7b38-49a0-b285-1328983b98c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:05.696478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-f6030b66-7b38-49a0-b285-1328983b98c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:05.698162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 144/276] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:05.704505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac57e7-2b14-4eb0-81f7-9500991ceeb6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:05.815419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac57e7-2b14-4eb0-81f7-9500991ceeb6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:05.852815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f0180-e91c-4c00-92ed-38e6399b28e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:05.853617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0180-e91c-4c00-92ed-38e6399b28e0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.853791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0180-e91c-4c00-92ed-38e6399b28e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.854060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0180-e91c-4c00-92ed-38e6399b28e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.854849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f0180-e91c-4c00-92ed-38e6399b28e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:05.855210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f0180-e91c-4c00-92ed-38e6399b28e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:05.857189 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f0180-e91c-4c00-92ed-38e6399b28e0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:05.865841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 133/277] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:05.871139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030b66-7b38-49a0-b285-1328983b98c9 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:05.984771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6030b66-7b38-49a0-b285-1328983b98c9 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:05.987584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c0394-fd64-4202-9220-d411cd821e6b None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.987885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c0394-fd64-4202-9220-d411cd821e6b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.988165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c0394-fd64-4202-9220-d411cd821e6b None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:05.989670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 134/278] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:05.995764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db846-ff1b-4fe6-aab8-b0959511638c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:05.996305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db846-ff1b-4fe6-aab8-b0959511638c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:05.996799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db846-ff1b-4fe6-aab8-b0959511638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:06.018409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-328db846-ff1b-4fe6-aab8-b0959511638c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:06.019655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-328db846-ff1b-4fe6-aab8-b0959511638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:06.022491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c0cd-a60b-4325-ac7c-1147e5ec1750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:06.023663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c0cd-a60b-4325-ac7c-1147e5ec1750 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:06.024185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c0cd-a60b-4325-ac7c-1147e5ec1750 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:06.024609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473c0cd-a60b-4325-ac7c-1147e5ec1750 None admin] PATH_INFO: `/v3/users/4e8a212a313a487cb36cdf54e401a9ee` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:06.039687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473c0cd-a60b-4325-ac7c-1147e5ec1750 None admin] RBAC: Authorizing `identity:get_user(user_id=4e8a212a313a487cb36cdf54e401a9ee)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:06.041393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473c0cd-a60b-4325-ac7c-1147e5ec1750 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:06.043600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 145/279] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:05 2022] GET /identity/v3/users/4e8a212a313a487cb36cdf54e401a9ee => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:06.050576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c0cd-a60b-4325-ac7c-1147e5ec1750 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:06.099633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 135/280] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:06.130831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328db846-ff1b-4fe6-aab8-b0959511638c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:06.202395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473c0cd-a60b-4325-ac7c-1147e5ec1750 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:06.241446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328db846-ff1b-4fe6-aab8-b0959511638c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:06.278117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcdb2b-3a4b-4b3a-8699-041a215714ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:06.279482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcdb2b-3a4b-4b3a-8699-041a215714ec None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:06.279769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcdb2b-3a4b-4b3a-8699-041a215714ec None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:06.280048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcdb2b-3a4b-4b3a-8699-041a215714ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:06.287896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:06.288556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:06.288836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:06.289112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:06.289951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] RBAC: Adding query filter params (role.id=fbf12d23efc946bdaacd8b4b123dd3fc, user.id=4e8a212a313a487cb36cdf54e401a9ee, scope.system=all) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:06.290284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:06.290386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcdb2b-3a4b-4b3a-8699-041a215714ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:06.291753 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:06.298216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-53bcdb2b-3a4b-4b3a-8699-041a215714ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:19:06.300187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 136/281] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:06.308721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 146/282] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Apr 28 16:19:06 2022] GET /identity/v3/role_assignments?user.id=4e8a212a313a487cb36cdf54e401a9ee&scope.system=all&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:06.309217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcdb2b-3a4b-4b3a-8699-041a215714ec None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:06.426335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcdb2b-3a4b-4b3a-8699-041a215714ec None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:06.473864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:06.474992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:06.475501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:06.475973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:06.476993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:06.477819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:06.480326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:06.494650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 137/283] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:06.500576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:06.616970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e004b79-b600-42b9-84cc-7257c9e30531 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:06.651268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980554f-68c3-4a3c-a149-ca1ee0321ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:06.652519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980554f-68c3-4a3c-a149-ca1ee0321ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:06.653010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980554f-68c3-4a3c-a149-ca1ee0321ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:06.654032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980554f-68c3-4a3c-a149-ca1ee0321ce9 None admin] PATH_INFO: `/v3/users/07a8216bbc3f495ca020e85ef1f3ec28` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:06.655456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980554f-68c3-4a3c-a149-ca1ee0321ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=07a8216bbc3f495ca020e85ef1f3ec28)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:06.657084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980554f-68c3-4a3c-a149-ca1ee0321ce9 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:06.658937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 147/284] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:06 2022] GET /identity/v3/users/07a8216bbc3f495ca020e85ef1f3ec28 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:06.664681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:06.786784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cae772-3a93-45af-9278-a7847ee63c9e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:06.831667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35613e9c-8b17-439e-950b-f57bdcad3a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:06.832901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35613e9c-8b17-439e-950b-f57bdcad3a7b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:06.833623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35613e9c-8b17-439e-950b-f57bdcad3a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:06.834097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35613e9c-8b17-439e-950b-f57bdcad3a7b None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:06.835611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35613e9c-8b17-439e-950b-f57bdcad3a7b None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:06.837303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35613e9c-8b17-439e-950b-f57bdcad3a7b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:06.839405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 138/285] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:06 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:06.846059 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980554f-68c3-4a3c-a149-ca1ee0321ce9 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:06.955331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980554f-68c3-4a3c-a149-ca1ee0321ce9 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:06.988973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc68b09-76d8-49c3-9dbd-8f2739b1e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:06.990244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68b09-76d8-49c3-9dbd-8f2739b1e40a None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:06.990794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68b09-76d8-49c3-9dbd-8f2739b1e40a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:06.991280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc68b09-76d8-49c3-9dbd-8f2739b1e40a None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/users/07a8216bbc3f495ca020e85ef1f3ec28/roles/5f2d9f744a2144228e697cda974d0a93` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:06.993439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc68b09-76d8-49c3-9dbd-8f2739b1e40a None admin] RBAC: Authorizing `identity:create_grant(project_id=06dd0f86b47846d2aa207c0f5574fbd6, user_id=07a8216bbc3f495ca020e85ef1f3ec28, role_id=5f2d9f744a2144228e697cda974d0a93)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:06.995118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc68b09-76d8-49c3-9dbd-8f2739b1e40a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:07.069793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 148/286] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:19:06 2022] PUT /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/users/07a8216bbc3f495ca020e85ef1f3ec28/roles/5f2d9f744a2144228e697cda974d0a93 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:07.218884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282feba0-e941-40bc-a089-e46350a7cc9d None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:07.219567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282feba0-e941-40bc-a089-e46350a7cc9d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:07.220045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282feba0-e941-40bc-a089-e46350a7cc9d None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:07.221671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 139/287] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:07.227385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206220-40df-4368-b5ff-7b9fe9e0ba2f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:07.227945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206220-40df-4368-b5ff-7b9fe9e0ba2f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:07.228444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206220-40df-4368-b5ff-7b9fe9e0ba2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:07.251213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-85206220-40df-4368-b5ff-7b9fe9e0ba2f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:07.252877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-85206220-40df-4368-b5ff-7b9fe9e0ba2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:07.331248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 149/288] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:07.355184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282feba0-e941-40bc-a089-e46350a7cc9d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:07.474243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282feba0-e941-40bc-a089-e46350a7cc9d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:07.514606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf1ff4-c032-4a5d-823a-40b02c252c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:07.515427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf1ff4-c032-4a5d-823a-40b02c252c14 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:07.515771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf1ff4-c032-4a5d-823a-40b02c252c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:07.516057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf1ff4-c032-4a5d-823a-40b02c252c14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:07.532232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf1ff4-c032-4a5d-823a-40b02c252c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:07.539532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-57bf1ff4-c032-4a5d-823a-40b02c252c14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:07.540784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 140/289] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:07.546612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85206220-40df-4368-b5ff-7b9fe9e0ba2f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:07.684867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85206220-40df-4368-b5ff-7b9fe9e0ba2f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:07.735282 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:07.735968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:07.736255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:07.736530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:07.737286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:07.737599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:07.739025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:07.750319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 150/290] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:07.755431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf1ff4-c032-4a5d-823a-40b02c252c14 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:07.881514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf1ff4-c032-4a5d-823a-40b02c252c14 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:07.922017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c082dd4-c234-4113-9bf4-259998520c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:07.922938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082dd4-c234-4113-9bf4-259998520c00 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:07.923230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082dd4-c234-4113-9bf4-259998520c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:07.923513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082dd4-c234-4113-9bf4-259998520c00 None admin] PATH_INFO: `/v3/users/adc032366c62403eae883fd06f60561d` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:07.924745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c082dd4-c234-4113-9bf4-259998520c00 None admin] RBAC: Authorizing `identity:get_user(user_id=adc032366c62403eae883fd06f60561d)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:07.926213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c082dd4-c234-4113-9bf4-259998520c00 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:07.928067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 141/291] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:07 2022] GET /identity/v3/users/adc032366c62403eae883fd06f60561d => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:07.933591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:08.090292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9dfac-ff44-4d10-b6fa-18b6509bf1ca None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:08.135273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec3299-bda9-4250-b9f4-2de3ad595577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:08.135941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3299-bda9-4250-b9f4-2de3ad595577 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:08.136230 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3299-bda9-4250-b9f4-2de3ad595577 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:08.136509 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3299-bda9-4250-b9f4-2de3ad595577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:08.225070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec3299-bda9-4250-b9f4-2de3ad595577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:08.226570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec3299-bda9-4250-b9f4-2de3ad595577 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:08.348619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 151/292] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:08.354236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c082dd4-c234-4113-9bf4-259998520c00 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:08.482612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b939f0-a1e9-4362-9291-88577ca444b4 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:08.482958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b939f0-a1e9-4362-9291-88577ca444b4 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:08.483177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b939f0-a1e9-4362-9291-88577ca444b4 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:08.484556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 152/293] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:08.495444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c082dd4-c234-4113-9bf4-259998520c00 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:08.500332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbdd12-d335-4dd7-a9f3-1edb41499a5a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:08.500925 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbdd12-d335-4dd7-a9f3-1edb41499a5a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:08.501426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbdd12-d335-4dd7-a9f3-1edb41499a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:08.533896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af320d7-4140-4765-9b5f-58a6c3b8e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:08.535032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af320d7-4140-4765-9b5f-58a6c3b8e8fd None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:08.535452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af320d7-4140-4765-9b5f-58a6c3b8e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:08.535912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af320d7-4140-4765-9b5f-58a6c3b8e8fd None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:08.536531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-47bbdd12-d335-4dd7-a9f3-1edb41499a5a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:08.537301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af320d7-4140-4765-9b5f-58a6c3b8e8fd None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:08.538166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-47bbdd12-d335-4dd7-a9f3-1edb41499a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:08.538786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af320d7-4140-4765-9b5f-58a6c3b8e8fd None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:08.544019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 142/294] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:08 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:08.547640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af320d7-4140-4765-9b5f-58a6c3b8e8fd None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:08.651849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af320d7-4140-4765-9b5f-58a6c3b8e8fd None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:08.673747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 153/295] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:08.687162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15dd4-0849-459a-ad4e-2247f032fd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:08.687828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15dd4-0849-459a-ad4e-2247f032fd12 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:08.688118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15dd4-0849-459a-ad4e-2247f032fd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:08.688402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15dd4-0849-459a-ad4e-2247f032fd12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:08.689254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c15dd4-0849-459a-ad4e-2247f032fd12 None admin] RBAC: Adding query filter params (role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6, user.id=adc032366c62403eae883fd06f60561d) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:08.689568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c15dd4-0849-459a-ad4e-2247f032fd12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:08.691057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c15dd4-0849-459a-ad4e-2247f032fd12 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:08.696961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 143/296] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:08 2022] GET /identity/v3/role_assignments?user.id=adc032366c62403eae883fd06f60561d&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:08.713373 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbdd12-d335-4dd7-a9f3-1edb41499a5a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:08.806372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82569d7-c3c9-484d-b87b-06b699e2c741 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:08.807045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82569d7-c3c9-484d-b87b-06b699e2c741 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:08.807579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82569d7-c3c9-484d-b87b-06b699e2c741 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:08.815724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 144/297] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:08.817705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1d23-2be6-4e63-a5f0-d45c02892e93 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:08.818236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1d23-2be6-4e63-a5f0-d45c02892e93 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:08.818774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1d23-2be6-4e63-a5f0-d45c02892e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:08.836099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbdd12-d335-4dd7-a9f3-1edb41499a5a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:08.851609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-247d1d23-2be6-4e63-a5f0-d45c02892e93 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:08.853266 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-247d1d23-2be6-4e63-a5f0-d45c02892e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:08.902334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2336f4-b229-4386-89eb-21e23b818290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:08.903129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2336f4-b229-4386-89eb-21e23b818290 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:08.903439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2336f4-b229-4386-89eb-21e23b818290 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:08.903718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2336f4-b229-4386-89eb-21e23b818290 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:08.919816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2336f4-b229-4386-89eb-21e23b818290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:08.928349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-4c2336f4-b229-4386-89eb-21e23b818290 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:19:08.930010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 154/298] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:08.936457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2336f4-b229-4386-89eb-21e23b818290 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:08.942619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 145/299] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:08.964639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d1d23-2be6-4e63-a5f0-d45c02892e93 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:09.072037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2336f4-b229-4386-89eb-21e23b818290 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.092304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d1d23-2be6-4e63-a5f0-d45c02892e93 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.113695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.114780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.115216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.115640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.116604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:09.117076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:09.118711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:09.128439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 155/300] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:09.133759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:09.134294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf8840-1d46-4c6e-a199-22303d3c967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.135351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8840-1d46-4c6e-a199-22303d3c967d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.135783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8840-1d46-4c6e-a199-22303d3c967d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.136204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf8840-1d46-4c6e-a199-22303d3c967d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.151544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf8840-1d46-4c6e-a199-22303d3c967d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:09.160156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-fbcf8840-1d46-4c6e-a199-22303d3c967d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:09.166720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 146/301] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:09.168370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf8840-1d46-4c6e-a199-22303d3c967d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:09.242391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45912f7d-9cd2-45db-8b41-12273e5825f0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.284663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba74859-6077-43ae-9d5e-065f52728cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.285826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74859-6077-43ae-9d5e-065f52728cec None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.286260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74859-6077-43ae-9d5e-065f52728cec None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.286721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba74859-6077-43ae-9d5e-065f52728cec None admin] PATH_INFO: `/v3/users/bee46c3bb6df41cf8262b80a0b3fea6a` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.291379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf8840-1d46-4c6e-a199-22303d3c967d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.300985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba74859-6077-43ae-9d5e-065f52728cec None admin] RBAC: Authorizing `identity:get_user(user_id=bee46c3bb6df41cf8262b80a0b3fea6a)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:09.302490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba74859-6077-43ae-9d5e-065f52728cec None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:09.304500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 156/302] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:09 2022] GET /identity/v3/users/bee46c3bb6df41cf8262b80a0b3fea6a => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:09.305775 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3551c-e8cc-4fbd-8430-195e27cd2874 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.306069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3551c-e8cc-4fbd-8430-195e27cd2874 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.306357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3551c-e8cc-4fbd-8430-195e27cd2874 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.307874 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 157/303] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:09.311357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3551c-e8cc-4fbd-8430-195e27cd2874 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:09.332614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c454a-8282-4c31-bc97-cd39febb38c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.333908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c454a-8282-4c31-bc97-cd39febb38c8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.334626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c454a-8282-4c31-bc97-cd39febb38c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.335076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c454a-8282-4c31-bc97-cd39febb38c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.336460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c454a-8282-4c31-bc97-cd39febb38c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:09.337161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c454a-8282-4c31-bc97-cd39febb38c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:09.339173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c454a-8282-4c31-bc97-cd39febb38c8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:09.347869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 147/304] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:09.347869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab284f44-d6e6-4e47-9e2b-878e3011e937 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.347869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab284f44-d6e6-4e47-9e2b-878e3011e937 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.347869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab284f44-d6e6-4e47-9e2b-878e3011e937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.366050 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ab284f44-d6e6-4e47-9e2b-878e3011e937 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:09.367397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ab284f44-d6e6-4e47-9e2b-878e3011e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:09.415840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3551c-e8cc-4fbd-8430-195e27cd2874 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.433431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 148/305] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:09.435234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab284f44-d6e6-4e47-9e2b-878e3011e937 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:09.456594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.457573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.457865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.458150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.459524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] RBAC: Adding query filter params (role.id=5f2d9f744a2144228e697cda974d0a93, user.id=bee46c3bb6df41cf8262b80a0b3fea6a, scope.system=all) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:09.459872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:09.461774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:09.468111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 158/306] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Apr 28 16:19:09 2022] GET /identity/v3/role_assignments?user.id=bee46c3bb6df41cf8262b80a0b3fea6a&scope.system=all&role.id=5f2d9f744a2144228e697cda974d0a93 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:09.468738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:09.573518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab284f44-d6e6-4e47-9e2b-878e3011e937 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.595820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde5b87-7abc-4a5c-94f4-b818581ee8be None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.611107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c613db-0cb0-4dcb-bfdb-94a899e35749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.612425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c613db-0cb0-4dcb-bfdb-94a899e35749 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.612919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c613db-0cb0-4dcb-bfdb-94a899e35749 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.613397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c613db-0cb0-4dcb-bfdb-94a899e35749 None admin] PATH_INFO: `/v3/users/4e8a212a313a487cb36cdf54e401a9ee` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.614979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c613db-0cb0-4dcb-bfdb-94a899e35749 None admin] RBAC: Authorizing `identity:get_user(user_id=4e8a212a313a487cb36cdf54e401a9ee)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:09.616693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c613db-0cb0-4dcb-bfdb-94a899e35749 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:09.618785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 149/307] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:09 2022] GET /identity/v3/users/4e8a212a313a487cb36cdf54e401a9ee => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:09.625012 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c613db-0cb0-4dcb-bfdb-94a899e35749 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:09.639686 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bcab9-1e77-4027-8850-db2b551c0373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.640608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bcab9-1e77-4027-8850-db2b551c0373 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.640900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bcab9-1e77-4027-8850-db2b551c0373 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.641180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bcab9-1e77-4027-8850-db2b551c0373 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.642937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bcab9-1e77-4027-8850-db2b551c0373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:09.644158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bcab9-1e77-4027-8850-db2b551c0373 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:09.645900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 159/308] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:09.652788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bcab9-1e77-4027-8850-db2b551c0373 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:09.748147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c613db-0cb0-4dcb-bfdb-94a899e35749 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.762805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bcab9-1e77-4027-8850-db2b551c0373 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:09.781593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30988e-2d74-4d85-94a4-a634f0e04611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.782916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30988e-2d74-4d85-94a4-a634f0e04611 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.783478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30988e-2d74-4d85-94a4-a634f0e04611 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.783767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30988e-2d74-4d85-94a4-a634f0e04611 None admin] PATH_INFO: `/v3/system/users/4e8a212a313a487cb36cdf54e401a9ee/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.785935 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30988e-2d74-4d85-94a4-a634f0e04611 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4e8a212a313a487cb36cdf54e401a9ee, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:09.788146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30988e-2d74-4d85-94a4-a634f0e04611 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:09.795756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c92b43-75dd-425d-84a1-b0226991fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:09.796423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c92b43-75dd-425d-84a1-b0226991fbb3 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.796711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c92b43-75dd-425d-84a1-b0226991fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.796998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c92b43-75dd-425d-84a1-b0226991fbb3 None admin] PATH_INFO: `/v3/groups` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.797675 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c92b43-75dd-425d-84a1-b0226991fbb3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:09.799144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c92b43-75dd-425d-84a1-b0226991fbb3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:09.896526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 150/309] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Apr 28 16:19:09 2022] PUT /identity/v3/system/users/4e8a212a313a487cb36cdf54e401a9ee/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:19:09.898955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7a7d-4fd4-430c-8685-10a606bcf435 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.899238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7a7d-4fd4-430c-8685-10a606bcf435 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.899528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7a7d-4fd4-430c-8685-10a606bcf435 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.901209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 151/310] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:09.907221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774900f-43bf-4dcc-b6ef-26d4ac9a7464 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:09.907512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774900f-43bf-4dcc-b6ef-26d4ac9a7464 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:09.907780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774900f-43bf-4dcc-b6ef-26d4ac9a7464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:09.926525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1774900f-43bf-4dcc-b6ef-26d4ac9a7464 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:09.927776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1774900f-43bf-4dcc-b6ef-26d4ac9a7464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:09.942640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 160/311] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Apr 28 16:19:09 2022] POST /identity/v3/groups => generated 229 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:10.013947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 152/312] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:10.037933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c92b43-75dd-425d-84a1-b0226991fbb3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:10.148219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c92b43-75dd-425d-84a1-b0226991fbb3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:10.183821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b2e6f-7b02-491c-b516-987ec0dbe9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:10.184980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b2e6f-7b02-491c-b516-987ec0dbe9ce None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:10.185445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b2e6f-7b02-491c-b516-987ec0dbe9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:10.185899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b2e6f-7b02-491c-b516-987ec0dbe9ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:10.196325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b2e6f-7b02-491c-b516-987ec0dbe9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:10.203697 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-a18b2e6f-7b02-491c-b516-987ec0dbe9ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:19:10.205523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 161/313] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:10.212768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774900f-43bf-4dcc-b6ef-26d4ac9a7464 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:10.311868 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774900f-43bf-4dcc-b6ef-26d4ac9a7464 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:10.345608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:10.346305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:10.346624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:10.346902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:10.347657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:10.347962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:10.349348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:10.358481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 153/314] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:10.363911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b2e6f-7b02-491c-b516-987ec0dbe9ce None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:10.463190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b2e6f-7b02-491c-b516-987ec0dbe9ce None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:10.502526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943a327-6e56-43f0-bac6-e4e2db29dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:10.503427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943a327-6e56-43f0-bac6-e4e2db29dd7e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:10.503711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943a327-6e56-43f0-bac6-e4e2db29dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:10.503989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943a327-6e56-43f0-bac6-e4e2db29dd7e None admin] PATH_INFO: `/v3/users/07a8216bbc3f495ca020e85ef1f3ec28` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:10.505200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943a327-6e56-43f0-bac6-e4e2db29dd7e None admin] RBAC: Authorizing `identity:get_user(user_id=07a8216bbc3f495ca020e85ef1f3ec28)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:10.506691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943a327-6e56-43f0-bac6-e4e2db29dd7e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:10.508602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 162/315] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:10 2022] GET /identity/v3/users/07a8216bbc3f495ca020e85ef1f3ec28 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:10.514024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:10.615053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7ebcd-d23d-43ee-86ee-4bf6beb52ae5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:10.649072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf7c5-76dd-4b34-a2f7-635aa6b8d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:10.649732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf7c5-76dd-4b34-a2f7-635aa6b8d72c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:10.650015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf7c5-76dd-4b34-a2f7-635aa6b8d72c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:10.650290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf7c5-76dd-4b34-a2f7-635aa6b8d72c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:10.719861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf7c5-76dd-4b34-a2f7-635aa6b8d72c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:10.721337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf7c5-76dd-4b34-a2f7-635aa6b8d72c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:10.819920 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 154/316] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:10.825335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943a327-6e56-43f0-bac6-e4e2db29dd7e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:10.927843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943a327-6e56-43f0-bac6-e4e2db29dd7e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:10.961081 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a8c70-4fe6-4ce0-ab25-fe7487932ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:10.961949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a8c70-4fe6-4ce0-ab25-fe7487932ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:10.962231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a8c70-4fe6-4ce0-ab25-fe7487932ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:10.962507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a8c70-4fe6-4ce0-ab25-fe7487932ac8 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:10.963722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a8c70-4fe6-4ce0-ab25-fe7487932ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:10.965169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a8c70-4fe6-4ce0-ab25-fe7487932ac8 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:10.967720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 163/317] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:10 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:10.973429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf7c5-76dd-4b34-a2f7-635aa6b8d72c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:11.085814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf7c5-76dd-4b34-a2f7-635aa6b8d72c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:11.119789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fd7de-7f43-4a4d-8db1-db2ee99e957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:11.120455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd7de-7f43-4a4d-8db1-db2ee99e957b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:11.120741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd7de-7f43-4a4d-8db1-db2ee99e957b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:11.121021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd7de-7f43-4a4d-8db1-db2ee99e957b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:11.121898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fd7de-7f43-4a4d-8db1-db2ee99e957b None admin] RBAC: Adding query filter params (role.id=5f2d9f744a2144228e697cda974d0a93, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6, user.id=07a8216bbc3f495ca020e85ef1f3ec28) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:11.122213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fd7de-7f43-4a4d-8db1-db2ee99e957b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:11.123695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fd7de-7f43-4a4d-8db1-db2ee99e957b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:11.129997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 155/318] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:10 2022] GET /identity/v3/role_assignments?user.id=07a8216bbc3f495ca020e85ef1f3ec28&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=5f2d9f744a2144228e697cda974d0a93 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:11.787828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448dcc-aaaa-4b11-86b7-430e8cd45844 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:11.788276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448dcc-aaaa-4b11-86b7-430e8cd45844 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:11.788573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448dcc-aaaa-4b11-86b7-430e8cd45844 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:11.790091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 164/319] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:11.795716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035de8d-bab2-4372-ae4a-d1bf4d3e9ccd None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:11.796147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035de8d-bab2-4372-ae4a-d1bf4d3e9ccd None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:11.796328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035de8d-bab2-4372-ae4a-d1bf4d3e9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:11.813337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-a035de8d-bab2-4372-ae4a-d1bf4d3e9ccd None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:11.814545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a035de8d-bab2-4372-ae4a-d1bf4d3e9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:11.885981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 156/320] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:11.908109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0448dcc-aaaa-4b11-86b7-430e8cd45844 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.010337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0448dcc-aaaa-4b11-86b7-430e8cd45844 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.046809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73610f73-c879-4e55-a4bc-bcc0f3b26696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.047955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610f73-c879-4e55-a4bc-bcc0f3b26696 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.048216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610f73-c879-4e55-a4bc-bcc0f3b26696 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.048495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610f73-c879-4e55-a4bc-bcc0f3b26696 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.058659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73610f73-c879-4e55-a4bc-bcc0f3b26696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:12.066227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-73610f73-c879-4e55-a4bc-bcc0f3b26696 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:19:12.067644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 165/321] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:12.073287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035de8d-bab2-4372-ae4a-d1bf4d3e9ccd None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.171742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035de8d-bab2-4372-ae4a-d1bf4d3e9ccd None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.179340 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1217-d8bc-450c-b2c5-247d678e9c66 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.179635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1217-d8bc-450c-b2c5-247d678e9c66 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.179916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1217-d8bc-450c-b2c5-247d678e9c66 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.181277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 166/322] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:12.186237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6179c10-2705-4f38-a85f-d4bd6eabbd79 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.186654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6179c10-2705-4f38-a85f-d4bd6eabbd79 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.187030 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6179c10-2705-4f38-a85f-d4bd6eabbd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.206618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f6179c10-2705-4f38-a85f-d4bd6eabbd79 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:12.207936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.208615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.208899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.208995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f6179c10-2705-4f38-a85f-d4bd6eabbd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:12.209237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.210461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:12.211050 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:12.213051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:12.222692 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 157/323] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:12.227601 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.283277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 167/324] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:12.307429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6179c10-2705-4f38-a85f-d4bd6eabbd79 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.331110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110a0f4-de98-47e3-a6c3-d04852e4fe73 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.362994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e130c-8f5c-460f-b64b-cc0ad73af76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.363870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e130c-8f5c-460f-b64b-cc0ad73af76d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.364156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e130c-8f5c-460f-b64b-cc0ad73af76d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.364436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e130c-8f5c-460f-b64b-cc0ad73af76d None admin] PATH_INFO: `/v3/users/bee46c3bb6df41cf8262b80a0b3fea6a` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.365626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e130c-8f5c-460f-b64b-cc0ad73af76d None admin] RBAC: Authorizing `identity:get_user(user_id=bee46c3bb6df41cf8262b80a0b3fea6a)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:12.367098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e130c-8f5c-460f-b64b-cc0ad73af76d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:12.368727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 158/325] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:12 2022] GET /identity/v3/users/bee46c3bb6df41cf8262b80a0b3fea6a => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:12.370003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ff712-8e3d-4abd-8457-8f7585818562 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.370356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ff712-8e3d-4abd-8457-8f7585818562 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.370668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ff712-8e3d-4abd-8457-8f7585818562 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.374575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 159/326] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:12.374575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ff712-8e3d-4abd-8457-8f7585818562 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.404088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6179c10-2705-4f38-a85f-d4bd6eabbd79 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.436644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e1d91-df42-4621-8a4e-f10f17f241ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.437442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e1d91-df42-4621-8a4e-f10f17f241ac None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.437730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e1d91-df42-4621-8a4e-f10f17f241ac None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.438013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e1d91-df42-4621-8a4e-f10f17f241ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.447797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e1d91-df42-4621-8a4e-f10f17f241ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:12.454954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-160e1d91-df42-4621-8a4e-f10f17f241ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:12.456305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 168/327] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:12.457296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a90e-d246-4db2-9712-14cb0b45c4f9 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.457587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a90e-d246-4db2-9712-14cb0b45c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.457871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327a90e-d246-4db2-9712-14cb0b45c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.468199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ff712-8e3d-4abd-8457-8f7585818562 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.474054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b327a90e-d246-4db2-9712-14cb0b45c4f9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:12.475275 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b327a90e-d246-4db2-9712-14cb0b45c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:12.505006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686fae-7f05-470f-a2aa-7dd84196fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.505879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686fae-7f05-470f-a2aa-7dd84196fbb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.506165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686fae-7f05-470f-a2aa-7dd84196fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.506447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686fae-7f05-470f-a2aa-7dd84196fbb6 None admin] PATH_INFO: `/v3/system/users/bee46c3bb6df41cf8262b80a0b3fea6a/roles/5f2d9f744a2144228e697cda974d0a93` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.509881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21686fae-7f05-470f-a2aa-7dd84196fbb6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bee46c3bb6df41cf8262b80a0b3fea6a, role_id=5f2d9f744a2144228e697cda974d0a93)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:12.511300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21686fae-7f05-470f-a2aa-7dd84196fbb6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:12.544760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 169/328] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:12.545683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327a90e-d246-4db2-9712-14cb0b45c4f9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.606786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 160/329] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Apr 28 16:19:12 2022] PUT /identity/v3/system/users/bee46c3bb6df41cf8262b80a0b3fea6a/roles/5f2d9f744a2144228e697cda974d0a93 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:19:12.607677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686fae-7f05-470f-a2aa-7dd84196fbb6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.645113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327a90e-d246-4db2-9712-14cb0b45c4f9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.681921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.682631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.682923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.683205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.683988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:12.684340 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:12.685796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:12.698920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 170/330] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:12.702120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.717787 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686fae-7f05-470f-a2aa-7dd84196fbb6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.753313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5b41-adb2-45ab-a9de-bbae64bde37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.754123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5b41-adb2-45ab-a9de-bbae64bde37f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.754410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5b41-adb2-45ab-a9de-bbae64bde37f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.754723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5b41-adb2-45ab-a9de-bbae64bde37f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.755988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5b41-adb2-45ab-a9de-bbae64bde37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:12.757460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5b41-adb2-45ab-a9de-bbae64bde37f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:12.764473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 161/331] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:12.765649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5b41-adb2-45ab-a9de-bbae64bde37f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.804758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b613a00-faac-42ce-b18b-799a6388023e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.838116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318f7a-259d-42c2-8fd2-b9e9334ee8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.839029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318f7a-259d-42c2-8fd2-b9e9334ee8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.839318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318f7a-259d-42c2-8fd2-b9e9334ee8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.839594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318f7a-259d-42c2-8fd2-b9e9334ee8f4 None admin] PATH_INFO: `/v3/users/4e8a212a313a487cb36cdf54e401a9ee` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.841337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23318f7a-259d-42c2-8fd2-b9e9334ee8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=4e8a212a313a487cb36cdf54e401a9ee)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:12.842967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23318f7a-259d-42c2-8fd2-b9e9334ee8f4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:12.845983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 171/332] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:12 2022] GET /identity/v3/users/4e8a212a313a487cb36cdf54e401a9ee => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:12.852343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318f7a-259d-42c2-8fd2-b9e9334ee8f4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:12.873037 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5b41-adb2-45ab-a9de-bbae64bde37f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.905746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa861b-79fc-44dc-9788-175e46e23ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.906419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa861b-79fc-44dc-9788-175e46e23ba0 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.906833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa861b-79fc-44dc-9788-175e46e23ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.907117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa861b-79fc-44dc-9788-175e46e23ba0 None admin] PATH_INFO: `/v3/groups` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.907806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa861b-79fc-44dc-9788-175e46e23ba0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:12.909245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa861b-79fc-44dc-9788-175e46e23ba0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:12.950683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318f7a-259d-42c2-8fd2-b9e9334ee8f4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:12.982420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773feb4-2aef-47e9-a178-2826c312e5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:12.983134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773feb4-2aef-47e9-a178-2826c312e5aa None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:12.983421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773feb4-2aef-47e9-a178-2826c312e5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:12.983712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773feb4-2aef-47e9-a178-2826c312e5aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:12.984546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773feb4-2aef-47e9-a178-2826c312e5aa None admin] RBAC: Adding query filter params (role.id=fbf12d23efc946bdaacd8b4b123dd3fc, user.id=4e8a212a313a487cb36cdf54e401a9ee, scope.system=all) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:12.984858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773feb4-2aef-47e9-a178-2826c312e5aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:12.986308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773feb4-2aef-47e9-a178-2826c312e5aa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:12.997980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 172/333] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Apr 28 16:19:12 2022] GET /identity/v3/role_assignments?user.id=4e8a212a313a487cb36cdf54e401a9ee&scope.system=all&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 510 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:13.010854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 162/334] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Apr 28 16:19:12 2022] POST /identity/v3/groups => generated 226 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:15.421743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b265ed-0485-49e1-a69b-be2466bed615 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:15.422280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b265ed-0485-49e1-a69b-be2466bed615 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:15.422280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b265ed-0485-49e1-a69b-be2466bed615 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:15.424139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 173/335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:15.430385 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18fe52-15f9-480b-bb3c-160893ed8cc7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:15.430997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18fe52-15f9-480b-bb3c-160893ed8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:15.430997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18fe52-15f9-480b-bb3c-160893ed8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:15.455611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7e18fe52-15f9-480b-bb3c-160893ed8cc7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:15.456846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7e18fe52-15f9-480b-bb3c-160893ed8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:15.541390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 163/336] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:15.585005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b265ed-0485-49e1-a69b-be2466bed615 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:15.666475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1dde-2c1c-41be-b756-bee56badeb5b None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:15.666806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1dde-2c1c-41be-b756-bee56badeb5b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:15.667090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c1dde-2c1c-41be-b756-bee56badeb5b None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:15.669193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 164/337] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:15.674815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ef1ed-34be-463b-b02c-c91aa679d013 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:15.675051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ef1ed-34be-463b-b02c-c91aa679d013 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:15.675338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ef1ed-34be-463b-b02c-c91aa679d013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:15.709024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-a98ef1ed-34be-463b-b02c-c91aa679d013 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:15.710227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a98ef1ed-34be-463b-b02c-c91aa679d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:15.713538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b265ed-0485-49e1-a69b-be2466bed615 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:15.779590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86e9f-e753-40a6-9dc6-0a91e79b8617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:15.782395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86e9f-e753-40a6-9dc6-0a91e79b8617 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:15.782395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86e9f-e753-40a6-9dc6-0a91e79b8617 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:15.782395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86e9f-e753-40a6-9dc6-0a91e79b8617 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:15.815051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f86e9f-e753-40a6-9dc6-0a91e79b8617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:15.827552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-88f86e9f-e753-40a6-9dc6-0a91e79b8617 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 28 16:19:15.834988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 174/338] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:15.843913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86e9f-e753-40a6-9dc6-0a91e79b8617 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:15.855340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 165/339] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:15.968646 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ef1ed-34be-463b-b02c-c91aa679d013 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:15.988071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86e9f-e753-40a6-9dc6-0a91e79b8617 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.036250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.037000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.037227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.037509 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.038288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:16.038659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:16.042048 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:16.053750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 175/340] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:16.059775 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:16.100551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ef1ed-34be-463b-b02c-c91aa679d013 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.144361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b6a3-4e8f-4e60-bc03-ee6952698360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.145193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b6a3-4e8f-4e60-bc03-ee6952698360 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.145533 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b6a3-4e8f-4e60-bc03-ee6952698360 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.145759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b6a3-4e8f-4e60-bc03-ee6952698360 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.159520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b6a3-4e8f-4e60-bc03-ee6952698360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:16.170683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-9a27b6a3-4e8f-4e60-bc03-ee6952698360 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:16.172290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 166/341] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:16.177848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b6a3-4e8f-4e60-bc03-ee6952698360 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:16.194899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d7058-75d7-4c05-86be-dc314b8c57fa None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.270674 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ceaf9-7641-4580-91dd-3c78255b296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.271499 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ceaf9-7641-4580-91dd-3c78255b296b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.271788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ceaf9-7641-4580-91dd-3c78255b296b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.272068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ceaf9-7641-4580-91dd-3c78255b296b None admin] PATH_INFO: `/v3/users/bee46c3bb6df41cf8262b80a0b3fea6a` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.279334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ceaf9-7641-4580-91dd-3c78255b296b None admin] RBAC: Authorizing `identity:get_user(user_id=bee46c3bb6df41cf8262b80a0b3fea6a)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:16.280808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ceaf9-7641-4580-91dd-3c78255b296b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:16.282828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 176/342] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/users/bee46c3bb6df41cf8262b80a0b3fea6a => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:16.284089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ac6a8-215c-4c1a-b788-30232e91f2e8 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.284379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ac6a8-215c-4c1a-b788-30232e91f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.284662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ac6a8-215c-4c1a-b788-30232e91f2e8 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.285985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 177/343] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:16.287095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c314ad-6742-44ed-8220-c6674bdad369 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.287477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c314ad-6742-44ed-8220-c6674bdad369 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.287737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c314ad-6742-44ed-8220-c6674bdad369 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.287941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b6a3-4e8f-4e60-bc03-ee6952698360 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.289224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 178/344] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:16.292583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d13c8-6c17-4e8b-b79f-1ac47e5fbe71 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.292881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d13c8-6c17-4e8b-b79f-1ac47e5fbe71 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.293165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d13c8-6c17-4e8b-b79f-1ac47e5fbe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.314374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-7d3d13c8-6c17-4e8b-b79f-1ac47e5fbe71 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:16.315910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-7d3d13c8-6c17-4e8b-b79f-1ac47e5fbe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:16.322903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.323592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.323880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.324185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.325464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] RBAC: Adding query filter params (name=member) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:16.325776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:16.327195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:16.341412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 167/345] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:16.342267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:16.404679 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 179/346] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:16.405805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169e06-9b4e-4f70-8d4a-1dd1ff586cd0 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.406083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169e06-9b4e-4f70-8d4a-1dd1ff586cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.406361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169e06-9b4e-4f70-8d4a-1dd1ff586cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.423046 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-5f169e06-9b4e-4f70-8d4a-1dd1ff586cd0 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:16.424243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5f169e06-9b4e-4f70-8d4a-1dd1ff586cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:16.452162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0960f8-6667-4326-9224-1a3b9a89e27b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.486632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.487656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.488147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.488644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.489690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] RBAC: Adding query filter params (role.id=5f2d9f744a2144228e697cda974d0a93, user.id=bee46c3bb6df41cf8262b80a0b3fea6a, scope.system=all) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:16.490210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:16.491866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:16.495363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 180/347] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:16.496107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169e06-9b4e-4f70-8d4a-1dd1ff586cd0 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:16.510236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 168/348] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/role_assignments?user.id=bee46c3bb6df41cf8262b80a0b3fea6a&scope.system=all&role.id=5f2d9f744a2144228e697cda974d0a93 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:16.511544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:16.604213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169e06-9b4e-4f70-8d4a-1dd1ff586cd0 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.638976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b79df-6350-4cbe-883f-7cab650f56e5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.640774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cce794-6a40-4892-ac62-d5f5d762597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.641566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce794-6a40-4892-ac62-d5f5d762597e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.641754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce794-6a40-4892-ac62-d5f5d762597e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.642001 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cce794-6a40-4892-ac62-d5f5d762597e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.675928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0782-f4f1-497f-999c-b0bd457b1a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.677086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0782-f4f1-497f-999c-b0bd457b1a8d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.677576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0782-f4f1-497f-999c-b0bd457b1a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.678086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0782-f4f1-497f-999c-b0bd457b1a8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.689754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db0782-f4f1-497f-999c-b0bd457b1a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:16.697232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-39db0782-f4f1-497f-999c-b0bd457b1a8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:16.699116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 169/349] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:16.700162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0782-f4f1-497f-999c-b0bd457b1a8d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:16.714291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cce794-6a40-4892-ac62-d5f5d762597e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:16.716322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cce794-6a40-4892-ac62-d5f5d762597e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:16.802670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0782-f4f1-497f-999c-b0bd457b1a8d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.819706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 181/350] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:16.820569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cce794-6a40-4892-ac62-d5f5d762597e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:16.838258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b24f39-d9ec-4d9c-b217-16eeb6b1bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.841118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b24f39-d9ec-4d9c-b217-16eeb6b1bf20 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.841614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b24f39-d9ec-4d9c-b217-16eeb6b1bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.842091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b24f39-d9ec-4d9c-b217-16eeb6b1bf20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.853580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b24f39-d9ec-4d9c-b217-16eeb6b1bf20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:16.863321 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-36b24f39-d9ec-4d9c-b217-16eeb6b1bf20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:19:16.864904 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 170/351] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:16.865874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b24f39-d9ec-4d9c-b217-16eeb6b1bf20 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:16.936659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cce794-6a40-4892-ac62-d5f5d762597e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.970432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b24f39-d9ec-4d9c-b217-16eeb6b1bf20 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:16.971972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:16.972723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:16.973084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:16.973436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:16.974623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:16.974623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:16.976119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:16.985913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 182/352] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:16.986810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.007352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c8b81-c0e5-42cc-9963-47d56aadce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.008551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c8b81-c0e5-42cc-9963-47d56aadce34 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.009010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c8b81-c0e5-42cc-9963-47d56aadce34 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.009467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c8b81-c0e5-42cc-9963-47d56aadce34 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.010876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c8b81-c0e5-42cc-9963-47d56aadce34 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.013049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c8b81-c0e5-42cc-9963-47d56aadce34 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.015027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 171/353] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:17.015976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c8b81-c0e5-42cc-9963-47d56aadce34 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.094755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e4e00-c2c2-4d72-a3a4-d4840f19d277 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:17.119755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c8b81-c0e5-42cc-9963-47d56aadce34 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:17.131969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.132576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.132964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.133385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.134158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:17.134582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.136044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.146718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 183/354] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:17.147475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.157945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08bdf8-beaa-4fa3-b77d-8958f17501df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.158902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08bdf8-beaa-4fa3-b77d-8958f17501df None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.159364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08bdf8-beaa-4fa3-b77d-8958f17501df None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.159814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08bdf8-beaa-4fa3-b77d-8958f17501df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.233818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08bdf8-beaa-4fa3-b77d-8958f17501df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.235759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08bdf8-beaa-4fa3-b77d-8958f17501df None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.260708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf15c7f-996f-4cbe-9b2a-6cafb7b149c1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:17.297897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882171-d792-4856-8129-fe988d7b0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.298898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882171-d792-4856-8129-fe988d7b0a5c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.299259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882171-d792-4856-8129-fe988d7b0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.299723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882171-d792-4856-8129-fe988d7b0a5c None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.306827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de882171-d792-4856-8129-fe988d7b0a5c None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.308074 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de882171-d792-4856-8129-fe988d7b0a5c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.309963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 184/355] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:17.310860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882171-d792-4856-8129-fe988d7b0a5c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.338007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 172/356] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:17.339213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08bdf8-beaa-4fa3-b77d-8958f17501df None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.412303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882171-d792-4856-8129-fe988d7b0a5c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:17.438125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08bdf8-beaa-4fa3-b77d-8958f17501df None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:17.452512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460b50e-1037-4210-9e64-064048880b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.452512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460b50e-1037-4210-9e64-064048880b56 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.452512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460b50e-1037-4210-9e64-064048880b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.453185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460b50e-1037-4210-9e64-064048880b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.475528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.476201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.476490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.476773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.477625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] RBAC: Adding query filter params (group.id=f761abe630444ee298f7b6dac5aa7568, role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:17.477944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.479560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.486990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 173/357] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/role_assignments?group.id=f761abe630444ee298f7b6dac5aa7568&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 260 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:17.489108 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.549979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460b50e-1037-4210-9e64-064048880b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.551665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460b50e-1037-4210-9e64-064048880b56 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.618219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eebec8-bda3-4e60-a0eb-54ef4b3a827b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:17.665527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a406626-a7c2-45a5-b8e9-5bed803e08e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.666369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a406626-a7c2-45a5-b8e9-5bed803e08e8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.666699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a406626-a7c2-45a5-b8e9-5bed803e08e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.666974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a406626-a7c2-45a5-b8e9-5bed803e08e8 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.668228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a406626-a7c2-45a5-b8e9-5bed803e08e8 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.668719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 185/358] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:17.669726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a406626-a7c2-45a5-b8e9-5bed803e08e8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.670602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96d7c-5ee3-438d-a613-dbedb96890f0 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.671099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96d7c-5ee3-438d-a613-dbedb96890f0 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.671578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf96d7c-5ee3-438d-a613-dbedb96890f0 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.672761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 174/359] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:17.673576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 186/360] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:17.679559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96d7c-5ee3-438d-a613-dbedb96890f0 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.680319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a406626-a7c2-45a5-b8e9-5bed803e08e8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.793768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a406626-a7c2-45a5-b8e9-5bed803e08e8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:17.811695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf96d7c-5ee3-438d-a613-dbedb96890f0 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:17.844847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee1025-e3f2-4ece-ab39-6456ee2f4c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.846080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee1025-e3f2-4ece-ab39-6456ee2f4c26 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.846362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee1025-e3f2-4ece-ab39-6456ee2f4c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.846686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee1025-e3f2-4ece-ab39-6456ee2f4c26 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.848398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee1025-e3f2-4ece-ab39-6456ee2f4c26 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.852125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee1025-e3f2-4ece-ab39-6456ee2f4c26 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.853001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 175/361] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:17.854448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ee4e3-8299-4681-bc1d-32f1a3dc57e9 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.854781 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ee4e3-8299-4681-bc1d-32f1a3dc57e9 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.855063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ee4e3-8299-4681-bc1d-32f1a3dc57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.864660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c2d6-5b0f-437b-87e4-9d98845df4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:17.865893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c2d6-5b0f-437b-87e4-9d98845df4fb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:17.866393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c2d6-5b0f-437b-87e4-9d98845df4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:17.866855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91c2d6-5b0f-437b-87e4-9d98845df4fb None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:17.868393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c2d6-5b0f-437b-87e4-9d98845df4fb None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:17.870131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91c2d6-5b0f-437b-87e4-9d98845df4fb None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:17.872719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 187/362] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:17.873665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c2d6-5b0f-437b-87e4-9d98845df4fb None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.875029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ea1ee4e3-8299-4681-bc1d-32f1a3dc57e9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:17.876237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ea1ee4e3-8299-4681-bc1d-32f1a3dc57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:17.955864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 176/363] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:17.957016 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ee4e3-8299-4681-bc1d-32f1a3dc57e9 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:17.998752 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91c2d6-5b0f-437b-87e4-9d98845df4fb None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.041969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d07089-54b7-428d-94b4-4b417adef22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:18.046290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d07089-54b7-428d-94b4-4b417adef22b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.046822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d07089-54b7-428d-94b4-4b417adef22b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.048021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d07089-54b7-428d-94b4-4b417adef22b None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.049692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d07089-54b7-428d-94b4-4b417adef22b None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:18.051208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d07089-54b7-428d-94b4-4b417adef22b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:18.053161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 188/364] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:18.054243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d07089-54b7-428d-94b4-4b417adef22b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:18.088176 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ee4e3-8299-4681-bc1d-32f1a3dc57e9 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.132528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:18.133199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.133487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.133766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.134653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] RBAC: Adding query filter params (group.id=f761abe630444ee298f7b6dac5aa7568, role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:18.134971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:18.136416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:18.143270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 177/365] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:17 2022] GET /identity/v3/role_assignments?group.id=f761abe630444ee298f7b6dac5aa7568&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:18.144154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:18.173793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d07089-54b7-428d-94b4-4b417adef22b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.212660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26c4d0-f589-4952-8d47-9aaf8807b0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:18.213815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26c4d0-f589-4952-8d47-9aaf8807b0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.214304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26c4d0-f589-4952-8d47-9aaf8807b0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.214824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26c4d0-f589-4952-8d47-9aaf8807b0b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.227528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26c4d0-f589-4952-8d47-9aaf8807b0b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:18.236503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-da26c4d0-f589-4952-8d47-9aaf8807b0b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:19:18.238176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 189/366] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:19:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:18.240409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960baa1a-1e2a-419e-a62e-58cd98432632 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.241003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960baa1a-1e2a-419e-a62e-58cd98432632 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.241507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960baa1a-1e2a-419e-a62e-58cd98432632 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.243146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 190/367] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:18.244116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960baa1a-1e2a-419e-a62e-58cd98432632 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:18.263860 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98806b9b-dfde-4860-8994-964a3e03100e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.307652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757df4fe-bbb7-4545-9bde-a0c8de9d15bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:18.308399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757df4fe-bbb7-4545-9bde-a0c8de9d15bd None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.308744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757df4fe-bbb7-4545-9bde-a0c8de9d15bd None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.309024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757df4fe-bbb7-4545-9bde-a0c8de9d15bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.310507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757df4fe-bbb7-4545-9bde-a0c8de9d15bd None admin] RBAC: Adding query filter params (group.id=f761abe630444ee298f7b6dac5aa7568, role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:18.310875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757df4fe-bbb7-4545-9bde-a0c8de9d15bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:18.312444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757df4fe-bbb7-4545-9bde-a0c8de9d15bd None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:18.326749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 178/368] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:18 2022] GET /identity/v3/role_assignments?group.id=f761abe630444ee298f7b6dac5aa7568&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:18.328304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5fd98-e68d-4a20-9250-7e3cb924b4c7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.328849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5fd98-e68d-4a20-9250-7e3cb924b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.328849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5fd98-e68d-4a20-9250-7e3cb924b4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.353247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-0cd5fd98-e68d-4a20-9250-7e3cb924b4c7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:18.354331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0cd5fd98-e68d-4a20-9250-7e3cb924b4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:18.377982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960baa1a-1e2a-419e-a62e-58cd98432632 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.421311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:18.422365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.422885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.423393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.425792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:18.426346 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:18.428965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:18.439718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 191/369] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:18.445739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:18.511650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 179/370] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:18.552320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5fd98-e68d-4a20-9250-7e3cb924b4c7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:18.583829 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14268e62-88ae-4f8f-8384-1ebe775bcac2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.625261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57298b9-d611-4fae-95e2-6d4f3fb5b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:18.626572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57298b9-d611-4fae-95e2-6d4f3fb5b7cf None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.627076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57298b9-d611-4fae-95e2-6d4f3fb5b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.627572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57298b9-d611-4fae-95e2-6d4f3fb5b7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.708141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5fd98-e68d-4a20-9250-7e3cb924b4c7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.713019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57298b9-d611-4fae-95e2-6d4f3fb5b7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:18.714682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57298b9-d611-4fae-95e2-6d4f3fb5b7cf None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:18.746871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b1452-390d-484d-87e2-21c11e86af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:18.748049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b1452-390d-484d-87e2-21c11e86af23 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.748540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b1452-390d-484d-87e2-21c11e86af23 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.749021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b1452-390d-484d-87e2-21c11e86af23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.762125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b1452-390d-484d-87e2-21c11e86af23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:18.769698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a73b1452-390d-484d-87e2-21c11e86af23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:19:18.772686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 180/371] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:18.781848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b1452-390d-484d-87e2-21c11e86af23 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:18.818997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 192/372] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:18.824934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57298b9-d611-4fae-95e2-6d4f3fb5b7cf None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:18.931645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57298b9-d611-4fae-95e2-6d4f3fb5b7cf None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.967476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ce7d1-1bac-4130-b0e0-fef55fc3d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:18.968539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce7d1-1bac-4130-b0e0-fef55fc3d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:18.968948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce7d1-1bac-4130-b0e0-fef55fc3d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:18.969241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b1452-390d-484d-87e2-21c11e86af23 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:18.969407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce7d1-1bac-4130-b0e0-fef55fc3d6f6 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:18.970764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ce7d1-1bac-4130-b0e0-fef55fc3d6f6 None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:18.972757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ce7d1-1bac-4130-b0e0-fef55fc3d6f6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:18.974426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 193/373] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:18 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:18.980763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ce7d1-1bac-4130-b0e0-fef55fc3d6f6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:19.023217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:19.023777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:19.024063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:19.026812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:19.026812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:19.026812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:19.026812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:19.045875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 181/374] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:19.055553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:19.112388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ce7d1-1bac-4130-b0e0-fef55fc3d6f6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:19.146921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121770f-306a-44a4-929c-bc4229f8c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:19.147795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121770f-306a-44a4-929c-bc4229f8c0fe None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:19.148084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121770f-306a-44a4-929c-bc4229f8c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:19.148365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121770f-306a-44a4-929c-bc4229f8c0fe None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:19.150788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121770f-306a-44a4-929c-bc4229f8c0fe None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:19.152247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121770f-306a-44a4-929c-bc4229f8c0fe None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:19.154847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 194/375] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:18 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:19.160302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121770f-306a-44a4-929c-bc4229f8c0fe None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:19.229627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15976-f9d4-4103-9d43-122ccf9ebfdf None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:19.274950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1361a-fec9-423c-9d4d-482f8bb8ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:19.277353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1361a-fec9-423c-9d4d-482f8bb8ce10 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:19.277922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1361a-fec9-423c-9d4d-482f8bb8ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:19.279022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1361a-fec9-423c-9d4d-482f8bb8ce10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:19.287655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121770f-306a-44a4-929c-bc4229f8c0fe None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:19.340189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:19.340913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:19.341201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:19.341483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:19.342335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] RBAC: Adding query filter params (group.id=f761abe630444ee298f7b6dac5aa7568, role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:19.342690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:19.344145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:19.360905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 195/376] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:19 2022] GET /identity/v3/role_assignments?group.id=f761abe630444ee298f7b6dac5aa7568&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:19.362968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1361a-fec9-423c-9d4d-482f8bb8ce10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:19.364777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1361a-fec9-423c-9d4d-482f8bb8ce10 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:19.483521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 182/377] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:19.489097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:19.649088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114293-9c19-4b01-b670-876c60dddbe2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:19.683482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358efda2-bd83-4d06-9ee9-824bb40134bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:19.684897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358efda2-bd83-4d06-9ee9-824bb40134bb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:19.685184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358efda2-bd83-4d06-9ee9-824bb40134bb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:19.685456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358efda2-bd83-4d06-9ee9-824bb40134bb None admin] PATH_INFO: `/v3/projects/0143687fa93942b783a5884094e78824` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:19.686692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358efda2-bd83-4d06-9ee9-824bb40134bb None admin] RBAC: Authorizing `identity:get_project(project_id=0143687fa93942b783a5884094e78824)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:19.688152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358efda2-bd83-4d06-9ee9-824bb40134bb None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:19.690167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 196/378] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:19 2022] GET /identity/v3/projects/0143687fa93942b783a5884094e78824 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:19.696709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1361a-fec9-423c-9d4d-482f8bb8ce10 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:19.824314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1361a-fec9-423c-9d4d-482f8bb8ce10 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:19.862045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c1147-19ae-4f6f-a737-6a36db2bbdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:19.862949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c1147-19ae-4f6f-a737-6a36db2bbdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:19.863237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c1147-19ae-4f6f-a737-6a36db2bbdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:19.863518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c1147-19ae-4f6f-a737-6a36db2bbdf4 None admin] PATH_INFO: `/v3/groups/0c85443895cd4db6a7201719ea0c4fe6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:19.871174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c1147-19ae-4f6f-a737-6a36db2bbdf4 None admin] RBAC: Authorizing `identity:get_group(group_id=0c85443895cd4db6a7201719ea0c4fe6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:19.873203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c1147-19ae-4f6f-a737-6a36db2bbdf4 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:19.875256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 183/379] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:19 2022] GET /identity/v3/groups/0c85443895cd4db6a7201719ea0c4fe6 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:19.881165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358efda2-bd83-4d06-9ee9-824bb40134bb None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:20.033108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358efda2-bd83-4d06-9ee9-824bb40134bb None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:20.091552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240b66d-fd2d-4ed1-9971-7d39448b8a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:20.092242 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240b66d-fd2d-4ed1-9971-7d39448b8a65 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:20.092534 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240b66d-fd2d-4ed1-9971-7d39448b8a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:20.092814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240b66d-fd2d-4ed1-9971-7d39448b8a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:20.093669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240b66d-fd2d-4ed1-9971-7d39448b8a65 None admin] RBAC: Adding query filter params (group.id=0c85443895cd4db6a7201719ea0c4fe6, role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=0143687fa93942b783a5884094e78824) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:20.093985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240b66d-fd2d-4ed1-9971-7d39448b8a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:20.095516 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240b66d-fd2d-4ed1-9971-7d39448b8a65 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:20.101899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 197/380] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:19 2022] GET /identity/v3/role_assignments?group.id=0c85443895cd4db6a7201719ea0c4fe6&scope.project.id=0143687fa93942b783a5884094e78824&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:20.239478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6470f-e1d5-4dde-81e2-1bb51afaaf28 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:20.239841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6470f-e1d5-4dde-81e2-1bb51afaaf28 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:20.240053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6470f-e1d5-4dde-81e2-1bb51afaaf28 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:20.241438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 184/381] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:20.247127 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069860-e594-443a-ab83-8d82ce53cc98 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:20.247421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069860-e594-443a-ab83-8d82ce53cc98 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:20.247706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d069860-e594-443a-ab83-8d82ce53cc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:20.265301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-9d069860-e594-443a-ab83-8d82ce53cc98 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:20.266554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-9d069860-e594-443a-ab83-8d82ce53cc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:20.337780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 198/382] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:20.362389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6470f-e1d5-4dde-81e2-1bb51afaaf28 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:20.474131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6470f-e1d5-4dde-81e2-1bb51afaaf28 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:20.519150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4b4f-6c99-45d1-be13-3aa05b36a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:20.519150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4b4f-6c99-45d1-be13-3aa05b36a681 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:20.519150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4b4f-6c99-45d1-be13-3aa05b36a681 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:20.519150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce4b4f-6c99-45d1-be13-3aa05b36a681 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:20.532177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce4b4f-6c99-45d1-be13-3aa05b36a681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:20.539777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-70ce4b4f-6c99-45d1-be13-3aa05b36a681 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:20.541239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 185/383] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:20.547250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d069860-e594-443a-ab83-8d82ce53cc98 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:20.687666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d069860-e594-443a-ab83-8d82ce53cc98 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:20.725768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:20.726445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:20.726759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:20.727042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:20.727801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:20.728109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:20.729495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:20.742251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 199/384] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:20.748187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4b4f-6c99-45d1-be13-3aa05b36a681 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:20.867535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce4b4f-6c99-45d1-be13-3aa05b36a681 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:20.909135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f42a0-8abe-4fb9-af20-8f7c5bba2597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:20.910024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f42a0-8abe-4fb9-af20-8f7c5bba2597 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:20.910310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f42a0-8abe-4fb9-af20-8f7c5bba2597 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:20.910610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f42a0-8abe-4fb9-af20-8f7c5bba2597 None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:20.911841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f42a0-8abe-4fb9-af20-8f7c5bba2597 None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:20.913372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f42a0-8abe-4fb9-af20-8f7c5bba2597 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:20.915353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 186/385] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:20 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:20.920855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:21.047834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27f6fb-2599-4e0a-8d0e-11e417d28ab1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:21.083422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2368dc-d57a-405d-aa01-501a628d01e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:21.084641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2368dc-d57a-405d-aa01-501a628d01e3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.085150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2368dc-d57a-405d-aa01-501a628d01e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.085628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2368dc-d57a-405d-aa01-501a628d01e3 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.087071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2368dc-d57a-405d-aa01-501a628d01e3 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:21.088722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2368dc-d57a-405d-aa01-501a628d01e3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:21.091661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 200/386] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:20 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:21.095989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910e70-b335-4e24-aa52-85f21959dbca None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.095989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910e70-b335-4e24-aa52-85f21959dbca None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.095989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52910e70-b335-4e24-aa52-85f21959dbca None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.095989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 187/387] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:21.097248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2368dc-d57a-405d-aa01-501a628d01e3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:21.103902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdea7d-124a-4770-9b65-d29deb7c89f2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.104190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdea7d-124a-4770-9b65-d29deb7c89f2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.104469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdea7d-124a-4770-9b65-d29deb7c89f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.139606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5dcdea7d-124a-4770-9b65-d29deb7c89f2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:21.140829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5dcdea7d-124a-4770-9b65-d29deb7c89f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:21.207531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2368dc-d57a-405d-aa01-501a628d01e3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:21.243408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec9b2b-aa75-4c26-acb5-f53240db5397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:21.244688 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec9b2b-aa75-4c26-acb5-f53240db5397 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.245203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec9b2b-aa75-4c26-acb5-f53240db5397 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.245686 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec9b2b-aa75-4c26-acb5-f53240db5397 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/groups/f761abe630444ee298f7b6dac5aa7568/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.248691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec9b2b-aa75-4c26-acb5-f53240db5397 None admin] RBAC: Authorizing `identity:create_grant(project_id=49a1ec22021e42d1aa1d63a70d01395f, group_id=f761abe630444ee298f7b6dac5aa7568, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:21.250457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec9b2b-aa75-4c26-acb5-f53240db5397 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:21.280016 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 188/388] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:21.304378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdea7d-124a-4770-9b65-d29deb7c89f2 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:21.336794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 201/389] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Apr 28 16:19:21 2022] PUT /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/groups/f761abe630444ee298f7b6dac5aa7568/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:21.440705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdea7d-124a-4770-9b65-d29deb7c89f2 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:21.482221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3b13-f0e8-4fb7-9ba3-cc57271afb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:21.483075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3b13-f0e8-4fb7-9ba3-cc57271afb15 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.483366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3b13-f0e8-4fb7-9ba3-cc57271afb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.483643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3b13-f0e8-4fb7-9ba3-cc57271afb15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.500743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a3b13-f0e8-4fb7-9ba3-cc57271afb15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:21.508069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-697a3b13-f0e8-4fb7-9ba3-cc57271afb15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:21.509700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 189/390] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:21.516237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec9b2b-aa75-4c26-acb5-f53240db5397 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:21.574441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24796-3a43-46dd-af99-10ac8189577a None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.574825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24796-3a43-46dd-af99-10ac8189577a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.575363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e24796-3a43-46dd-af99-10ac8189577a None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.577166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 190/391] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:21.582394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26ff9-92f0-4bbe-9712-29061ba97a4a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.582959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26ff9-92f0-4bbe-9712-29061ba97a4a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.583456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26ff9-92f0-4bbe-9712-29061ba97a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.604184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-03e26ff9-92f0-4bbe-9712-29061ba97a4a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:21.605398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-03e26ff9-92f0-4bbe-9712-29061ba97a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:21.690314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec9b2b-aa75-4c26-acb5-f53240db5397 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:21.701811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 191/392] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:21.727337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e26ff9-92f0-4bbe-9712-29061ba97a4a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:21.760298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:21.760985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.761284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.761570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.762368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:21.766777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:21.768218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:21.782080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 202/393] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:21.787302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:21.839228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e26ff9-92f0-4bbe-9712-29061ba97a4a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:21.877245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d90027-0315-4088-a52b-603e516bb4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:21.878557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d90027-0315-4088-a52b-603e516bb4be None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:21.878855 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d90027-0315-4088-a52b-603e516bb4be None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:21.879140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d90027-0315-4088-a52b-603e516bb4be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:21.890961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d90027-0315-4088-a52b-603e516bb4be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:21.900983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-49d90027-0315-4088-a52b-603e516bb4be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:19:21.902576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 192/394] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:19:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:21.908902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d90027-0315-4088-a52b-603e516bb4be None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:22.023773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d90027-0315-4088-a52b-603e516bb4be None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:22.053965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298998-308d-42bf-aef2-5580977da0aa None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:22.077438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:22.079436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.079732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.080012 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.080779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:22.081090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:22.082479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:22.108891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 193/395] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:22.116057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:22.130423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004809c4-fe2e-4079-ba24-7880ade2553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:22.131557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004809c4-fe2e-4079-ba24-7880ade2553b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.131843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004809c4-fe2e-4079-ba24-7880ade2553b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.132119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004809c4-fe2e-4079-ba24-7880ade2553b None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.134385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004809c4-fe2e-4079-ba24-7880ade2553b None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:22.135868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004809c4-fe2e-4079-ba24-7880ade2553b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:22.137556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 203/396] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:21 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:22.144490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004809c4-fe2e-4079-ba24-7880ade2553b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:22.289595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004809c4-fe2e-4079-ba24-7880ade2553b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:22.329117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ddb54-506f-4820-87f3-7b128b6c94a5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:22.359556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4478386-9c36-43f2-b831-fa5fc103683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:22.360360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4478386-9c36-43f2-b831-fa5fc103683e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.360650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4478386-9c36-43f2-b831-fa5fc103683e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.360938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4478386-9c36-43f2-b831-fa5fc103683e None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.363181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4478386-9c36-43f2-b831-fa5fc103683e None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:22.364659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4478386-9c36-43f2-b831-fa5fc103683e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:22.366389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 204/397] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:22 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:22.372513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4478386-9c36-43f2-b831-fa5fc103683e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:22.386346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad163658-1ed9-4d52-821c-267b7a87deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:22.387836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163658-1ed9-4d52-821c-267b7a87deb6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.388123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163658-1ed9-4d52-821c-267b7a87deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.388402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163658-1ed9-4d52-821c-267b7a87deb6 None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.389988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad163658-1ed9-4d52-821c-267b7a87deb6 None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:22.391475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad163658-1ed9-4d52-821c-267b7a87deb6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:22.393190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 194/398] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:22 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:22.399224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad163658-1ed9-4d52-821c-267b7a87deb6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:22.515218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad163658-1ed9-4d52-821c-267b7a87deb6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:22.562150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaa520-0e44-4d55-9fe7-02c89d754f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:22.563426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaa520-0e44-4d55-9fe7-02c89d754f06 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.563918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaa520-0e44-4d55-9fe7-02c89d754f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.564427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaa520-0e44-4d55-9fe7-02c89d754f06 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.566176 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaa520-0e44-4d55-9fe7-02c89d754f06 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:22.567942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaa520-0e44-4d55-9fe7-02c89d754f06 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:22.575769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 195/399] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:22 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:22.581306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaa520-0e44-4d55-9fe7-02c89d754f06 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:22.607744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4478386-9c36-43f2-b831-fa5fc103683e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:22.644632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea04b54-db75-4851-8dc0-654044d2b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:22.645863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea04b54-db75-4851-8dc0-654044d2b1f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.646368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea04b54-db75-4851-8dc0-654044d2b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.646914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea04b54-db75-4851-8dc0-654044d2b1f8 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/groups/f761abe630444ee298f7b6dac5aa7568/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.649160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea04b54-db75-4851-8dc0-654044d2b1f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=06dd0f86b47846d2aa207c0f5574fbd6, group_id=f761abe630444ee298f7b6dac5aa7568, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:22.650862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea04b54-db75-4851-8dc0-654044d2b1f8 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:22.696910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaa520-0e44-4d55-9fe7-02c89d754f06 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:22.732726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 205/400] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Apr 28 16:19:22 2022] PUT /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/groups/f761abe630444ee298f7b6dac5aa7568/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:22.739324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57481d-da44-438c-9c3f-a1a0767a8e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:22.740683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57481d-da44-438c-9c3f-a1a0767a8e6b None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.741160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57481d-da44-438c-9c3f-a1a0767a8e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.741657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57481d-da44-438c-9c3f-a1a0767a8e6b None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/groups/f761abe630444ee298f7b6dac5aa7568/roles/caa40465e0b0487aa66fec9cda30ce92` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.744749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57481d-da44-438c-9c3f-a1a0767a8e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=49a1ec22021e42d1aa1d63a70d01395f, group_id=f761abe630444ee298f7b6dac5aa7568, role_id=caa40465e0b0487aa66fec9cda30ce92)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:22.747167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57481d-da44-438c-9c3f-a1a0767a8e6b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:22.770220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798c02-fd43-4ba2-8a3a-89890103abef None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.770980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798c02-fd43-4ba2-8a3a-89890103abef None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.771549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad798c02-fd43-4ba2-8a3a-89890103abef None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.773625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 206/401] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:22.779212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f930ce-4c3d-4286-bb6d-df8e9184b136 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:22.779782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f930ce-4c3d-4286-bb6d-df8e9184b136 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:22.780295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f930ce-4c3d-4286-bb6d-df8e9184b136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:22.799647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-10f930ce-4c3d-4286-bb6d-df8e9184b136 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:22.801359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-10f930ce-4c3d-4286-bb6d-df8e9184b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:22.857599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 196/402] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Apr 28 16:19:22 2022] PUT /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f/groups/f761abe630444ee298f7b6dac5aa7568/roles/caa40465e0b0487aa66fec9cda30ce92 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:19:22.889032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 207/403] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:22.916191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57481d-da44-438c-9c3f-a1a0767a8e6b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:23.036622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57481d-da44-438c-9c3f-a1a0767a8e6b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:23.074437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008dea8-d5c8-4eb9-9132-040f9d0e57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:23.075992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008dea8-d5c8-4eb9-9132-040f9d0e57d2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.076285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008dea8-d5c8-4eb9-9132-040f9d0e57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.076565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008dea8-d5c8-4eb9-9132-040f9d0e57d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.089448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008dea8-d5c8-4eb9-9132-040f9d0e57d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:23.097313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-7008dea8-d5c8-4eb9-9132-040f9d0e57d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:19:23.099005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 197/404] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:19:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:23.104889 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f930ce-4c3d-4286-bb6d-df8e9184b136 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:23.252098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f930ce-4c3d-4286-bb6d-df8e9184b136 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:23.281194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2816-a16c-4f0e-b902-aa9ccb5dbfe5 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.281494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2816-a16c-4f0e-b902-aa9ccb5dbfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.281766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2816-a16c-4f0e-b902-aa9ccb5dbfe5 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.287659 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 198/405] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:23.290890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:23.291819 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.292305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.292781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.293799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:23.294307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:23.295948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:23.307166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e96-a4c4-435f-b3d3-6a279630e5e3 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.307448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e96-a4c4-435f-b3d3-6a279630e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.307732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e96-a4c4-435f-b3d3-6a279630e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.310505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 208/406] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:23.316471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:23.339390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-65804e96-a4c4-435f-b3d3-6a279630e5e3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:23.340636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-65804e96-a4c4-435f-b3d3-6a279630e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:23.462703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 199/407] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:23.482251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272d291-5f11-4f29-9711-382b3c5b98db None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:23.501012 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65804e96-a4c4-435f-b3d3-6a279630e5e3 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:23.543922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c914617-b547-4b1b-8eba-9b0ab5900677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:23.544744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c914617-b547-4b1b-8eba-9b0ab5900677 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.545032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c914617-b547-4b1b-8eba-9b0ab5900677 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.545307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c914617-b547-4b1b-8eba-9b0ab5900677 None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.546565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c914617-b547-4b1b-8eba-9b0ab5900677 None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:23.548157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c914617-b547-4b1b-8eba-9b0ab5900677 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:23.551233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 209/408] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:23 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:23.565998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c914617-b547-4b1b-8eba-9b0ab5900677 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:23.664757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65804e96-a4c4-435f-b3d3-6a279630e5e3 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:23.691745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c914617-b547-4b1b-8eba-9b0ab5900677 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:23.728517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926be4-9dd6-424b-94a3-0e3174dfbe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:23.729683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926be4-9dd6-424b-94a3-0e3174dfbe4c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.730170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926be4-9dd6-424b-94a3-0e3174dfbe4c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.730651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83926be4-9dd6-424b-94a3-0e3174dfbe4c None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.732577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83926be4-9dd6-424b-94a3-0e3174dfbe4c None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:23.734219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83926be4-9dd6-424b-94a3-0e3174dfbe4c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:23.741753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322fb4-4afc-4675-98e7-d3de99f30d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:23.741753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322fb4-4afc-4675-98e7-d3de99f30d95 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.741753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322fb4-4afc-4675-98e7-d3de99f30d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.741753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322fb4-4afc-4675-98e7-d3de99f30d95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.742262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 210/409] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:23 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:23.743665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926be4-9dd6-424b-94a3-0e3174dfbe4c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:23.769572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25322fb4-4afc-4675-98e7-d3de99f30d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:23.776947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-25322fb4-4afc-4675-98e7-d3de99f30d95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:19:23.787027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 200/410] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:23.792567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322fb4-4afc-4675-98e7-d3de99f30d95 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:23.846708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83926be4-9dd6-424b-94a3-0e3174dfbe4c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:23.886560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d660796-32a7-4d1d-af18-5ab378baa618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:23.886560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660796-32a7-4d1d-af18-5ab378baa618 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.886560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660796-32a7-4d1d-af18-5ab378baa618 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.886560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d660796-32a7-4d1d-af18-5ab378baa618 None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/groups/f761abe630444ee298f7b6dac5aa7568/roles/caa40465e0b0487aa66fec9cda30ce92` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.886967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d660796-32a7-4d1d-af18-5ab378baa618 None admin] RBAC: Authorizing `identity:create_grant(project_id=06dd0f86b47846d2aa207c0f5574fbd6, group_id=f761abe630444ee298f7b6dac5aa7568, role_id=caa40465e0b0487aa66fec9cda30ce92)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:23.886967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d660796-32a7-4d1d-af18-5ab378baa618 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:23.950921 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322fb4-4afc-4675-98e7-d3de99f30d95 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:23.977971 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 211/411] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Apr 28 16:19:23 2022] PUT /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6/groups/f761abe630444ee298f7b6dac5aa7568/roles/caa40465e0b0487aa66fec9cda30ce92 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:23.995552 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:23.996286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:23.996615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:23.996900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:23.997713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:23.998029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:23.999581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:24.009762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 201/412] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:24.016756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d660796-32a7-4d1d-af18-5ab378baa618 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:24.137695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d660796-32a7-4d1d-af18-5ab378baa618 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:24.183822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d436d5b-a00b-4b01-87c6-183e9845f77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:24.185130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436d5b-a00b-4b01-87c6-183e9845f77f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:24.185654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436d5b-a00b-4b01-87c6-183e9845f77f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:24.186145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d436d5b-a00b-4b01-87c6-183e9845f77f None admin] PATH_INFO: `/v3/groups/0c85443895cd4db6a7201719ea0c4fe6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:24.187828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d436d5b-a00b-4b01-87c6-183e9845f77f None admin] RBAC: Authorizing `identity:get_group(group_id=0c85443895cd4db6a7201719ea0c4fe6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:24.189577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d436d5b-a00b-4b01-87c6-183e9845f77f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:24.191979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 212/413] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:24 2022] GET /identity/v3/groups/0c85443895cd4db6a7201719ea0c4fe6 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:24.199019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:24.319999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ebe7-c1e4-4a95-ac30-929cbf10a9f6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:24.362134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7145e3-89b1-431e-9520-bcde5d481f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:24.363052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7145e3-89b1-431e-9520-bcde5d481f20 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:24.363340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7145e3-89b1-431e-9520-bcde5d481f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:24.363619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7145e3-89b1-431e-9520-bcde5d481f20 None admin] PATH_INFO: `/v3/projects/0143687fa93942b783a5884094e78824` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:24.364411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e1ed-0abc-4b50-96fd-c1c505695f46 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:24.364706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e1ed-0abc-4b50-96fd-c1c505695f46 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:24.364868 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7145e3-89b1-431e-9520-bcde5d481f20 None admin] RBAC: Authorizing `identity:get_project(project_id=0143687fa93942b783a5884094e78824)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:24.365019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e1ed-0abc-4b50-96fd-c1c505695f46 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:24.366322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7145e3-89b1-431e-9520-bcde5d481f20 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:24.368323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 202/415] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:24 2022] GET /identity/v3/projects/0143687fa93942b783a5884094e78824 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:24.370233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 213/415] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:24.372078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d870f4-7610-4bb9-8d1f-ee0c29edae60 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:24.372382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d870f4-7610-4bb9-8d1f-ee0c29edae60 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:24.372660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d870f4-7610-4bb9-8d1f-ee0c29edae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:24.374511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e1ed-0abc-4b50-96fd-c1c505695f46 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:24.398430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-c4d870f4-7610-4bb9-8d1f-ee0c29edae60 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:24.399582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c4d870f4-7610-4bb9-8d1f-ee0c29edae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:24.524232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 203/416] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:24.539190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e1ed-0abc-4b50-96fd-c1c505695f46 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:24.548562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d870f4-7610-4bb9-8d1f-ee0c29edae60 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:24.592640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178a65d-a1d4-4500-93fa-85e7cf960dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:24.593521 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a65d-a1d4-4500-93fa-85e7cf960dd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:24.593806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a65d-a1d4-4500-93fa-85e7cf960dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:24.594082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178a65d-a1d4-4500-93fa-85e7cf960dd2 None admin] PATH_INFO: `/v3/projects/0143687fa93942b783a5884094e78824/groups/0c85443895cd4db6a7201719ea0c4fe6/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:24.598744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178a65d-a1d4-4500-93fa-85e7cf960dd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0143687fa93942b783a5884094e78824, group_id=0c85443895cd4db6a7201719ea0c4fe6, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:24.600185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178a65d-a1d4-4500-93fa-85e7cf960dd2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:24.672790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 214/417] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Apr 28 16:19:24 2022] PUT /identity/v3/projects/0143687fa93942b783a5884094e78824/groups/0c85443895cd4db6a7201719ea0c4fe6/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:24.672950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d870f4-7610-4bb9-8d1f-ee0c29edae60 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:24.710983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02f935-2688-4dbd-a577-e1b7d983317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:24.711901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f935-2688-4dbd-a577-e1b7d983317c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:24.712242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f935-2688-4dbd-a577-e1b7d983317c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:24.712521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f935-2688-4dbd-a577-e1b7d983317c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:24.729765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02f935-2688-4dbd-a577-e1b7d983317c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:24.737398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-eb02f935-2688-4dbd-a577-e1b7d983317c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:24.738681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 204/418] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:24.744666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178a65d-a1d4-4500-93fa-85e7cf960dd2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:24.858487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178a65d-a1d4-4500-93fa-85e7cf960dd2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:24.894356 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:24.895075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:24.895364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:24.895646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:24.896416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:24.896729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:24.898141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:24.908299 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 215/419] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:24.916661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02f935-2688-4dbd-a577-e1b7d983317c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:25.053964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02f935-2688-4dbd-a577-e1b7d983317c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:25.089711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a855d5-2fc9-44ca-8fed-a4e6470a0e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:25.090427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a855d5-2fc9-44ca-8fed-a4e6470a0e89 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:25.090744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a855d5-2fc9-44ca-8fed-a4e6470a0e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:25.091024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a855d5-2fc9-44ca-8fed-a4e6470a0e89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:25.160922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a855d5-2fc9-44ca-8fed-a4e6470a0e89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:25.162376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a855d5-2fc9-44ca-8fed-a4e6470a0e89 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:25.263178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 205/420] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:25.268826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:25.384139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f40ec5-c544-4810-81f8-33a4a3f69373 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:25.422111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7e04f-479e-4666-be0c-bf5c8ae16892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:25.423017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e04f-479e-4666-be0c-bf5c8ae16892 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:25.423301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e04f-479e-4666-be0c-bf5c8ae16892 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:25.423579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e04f-479e-4666-be0c-bf5c8ae16892 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:25.424791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7e04f-479e-4666-be0c-bf5c8ae16892 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:25.426227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7e04f-479e-4666-be0c-bf5c8ae16892 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:25.428529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 216/421] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:25 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:25.433627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a855d5-2fc9-44ca-8fed-a4e6470a0e89 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:25.569318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a855d5-2fc9-44ca-8fed-a4e6470a0e89 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:25.603010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666dad5-db6e-489f-b8a6-5d50b04eb351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:25.603932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666dad5-db6e-489f-b8a6-5d50b04eb351 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:25.604220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666dad5-db6e-489f-b8a6-5d50b04eb351 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:25.604495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666dad5-db6e-489f-b8a6-5d50b04eb351 None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:25.605682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666dad5-db6e-489f-b8a6-5d50b04eb351 None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:25.607192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666dad5-db6e-489f-b8a6-5d50b04eb351 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:25.609114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 206/422] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:25 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:25.614520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7e04f-479e-4666-be0c-bf5c8ae16892 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:25.771415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7e04f-479e-4666-be0c-bf5c8ae16892 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:25.821959 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b072c-534b-44a2-ad9f-5bdfcd09cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:25.823072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b072c-534b-44a2-ad9f-5bdfcd09cb37 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:25.823579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b072c-534b-44a2-ad9f-5bdfcd09cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:25.824087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b072c-534b-44a2-ad9f-5bdfcd09cb37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:25.825197 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b072c-534b-44a2-ad9f-5bdfcd09cb37 None admin] RBAC: Adding query filter params (group.id=f761abe630444ee298f7b6dac5aa7568, role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:25.825714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b072c-534b-44a2-ad9f-5bdfcd09cb37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:25.827383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b072c-534b-44a2-ad9f-5bdfcd09cb37 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:25.839614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 217/423] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:25 2022] GET /identity/v3/role_assignments?group.id=f761abe630444ee298f7b6dac5aa7568&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:25.906455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2805c-659c-4810-b0c7-d801c21ec7e6 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:25.906845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2805c-659c-4810-b0c7-d801c21ec7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:25.907066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2805c-659c-4810-b0c7-d801c21ec7e6 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:25.908853 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 207/424] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:25.914179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82302-e0e5-43f6-bcee-db367bcb8b35 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:25.914784 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82302-e0e5-43f6-bcee-db367bcb8b35 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:25.915327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f82302-e0e5-43f6-bcee-db367bcb8b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:25.935401 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e0f82302-e0e5-43f6-bcee-db367bcb8b35 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:25.937011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e0f82302-e0e5-43f6-bcee-db367bcb8b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:26.030112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 218/425] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:26.061255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2805c-659c-4810-b0c7-d801c21ec7e6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:26.075964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8687-1520-4597-8214-a4fa8248cb06 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.076270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8687-1520-4597-8214-a4fa8248cb06 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.076541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8687-1520-4597-8214-a4fa8248cb06 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.079175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 219/426] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:26.085619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395eef2-3265-4fb8-a3ae-56a9a907f950 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.087146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395eef2-3265-4fb8-a3ae-56a9a907f950 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.087445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395eef2-3265-4fb8-a3ae-56a9a907f950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.125934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1395eef2-3265-4fb8-a3ae-56a9a907f950 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:26.127189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1395eef2-3265-4fb8-a3ae-56a9a907f950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:26.201617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2805c-659c-4810-b0c7-d801c21ec7e6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:26.207142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 220/427] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:26.233315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395eef2-3265-4fb8-a3ae-56a9a907f950 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:26.247891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceaa98-7054-45b2-b519-0303a940d278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:26.249075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceaa98-7054-45b2-b519-0303a940d278 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.249558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceaa98-7054-45b2-b519-0303a940d278 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.250032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceaa98-7054-45b2-b519-0303a940d278 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.268824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ceaa98-7054-45b2-b519-0303a940d278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:26.277520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-33ceaa98-7054-45b2-b519-0303a940d278 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:19:26.280235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 208/428] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:26.287800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceaa98-7054-45b2-b519-0303a940d278 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:26.360572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395eef2-3265-4fb8-a3ae-56a9a907f950 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:26.398980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4390379-6fd9-4da8-9eb5-a9ca1088e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:26.400191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4390379-6fd9-4da8-9eb5-a9ca1088e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.400710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4390379-6fd9-4da8-9eb5-a9ca1088e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.401258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4390379-6fd9-4da8-9eb5-a9ca1088e8ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.414389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4390379-6fd9-4da8-9eb5-a9ca1088e8ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:26.420087 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceaa98-7054-45b2-b519-0303a940d278 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:26.424407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-d4390379-6fd9-4da8-9eb5-a9ca1088e8ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 28 16:19:26.426491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 221/429] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:26.436673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4390379-6fd9-4da8-9eb5-a9ca1088e8ac None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:26.468187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:26.468882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.469172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.469450 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.470399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:26.470745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:26.472789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:26.484672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 209/430] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:26.490119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:26.551467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4390379-6fd9-4da8-9eb5-a9ca1088e8ac None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:26.585704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:26.586799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.587311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.587787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.588825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] RBAC: Adding query filter params (name=member) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:26.589335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:26.591457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:26.597113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd0de-ddea-4d7a-99c7-feb643b4b752 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:26.605129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 222/431] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:19:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:26.607823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:26.636379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcbbbe-c716-4f17-b948-45da2e98633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:26.637453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcbbbe-c716-4f17-b948-45da2e98633d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.637962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcbbbe-c716-4f17-b948-45da2e98633d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.638461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcbbbe-c716-4f17-b948-45da2e98633d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.724380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0720c42-408e-4cbb-81d4-8d96f64ef11c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:26.726995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcbbbe-c716-4f17-b948-45da2e98633d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:26.728461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcbbbe-c716-4f17-b948-45da2e98633d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:26.760466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf0ba4-d377-470b-8a0b-d9097468816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:26.761122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0ba4-d377-470b-8a0b-d9097468816f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.761410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0ba4-d377-470b-8a0b-d9097468816f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.761692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf0ba4-d377-470b-8a0b-d9097468816f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.824703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 210/432] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 16:19:26.826111 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a189-c106-46f5-9063-366d41d675b9 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.826406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a189-c106-46f5-9063-366d41d675b9 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.826716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a189-c106-46f5-9063-366d41d675b9 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.828165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 211/433] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:26.829966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8a189-c106-46f5-9063-366d41d675b9 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:26.835374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf0ba4-d377-470b-8a0b-d9097468816f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:26.836866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf0ba4-d377-470b-8a0b-d9097468816f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:26.931587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8a189-c106-46f5-9063-366d41d675b9 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:26.937923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 223/434] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 16:19:26.937923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12af4bc-555a-4eae-811e-b5c33507a73b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.937923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12af4bc-555a-4eae-811e-b5c33507a73b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.937923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12af4bc-555a-4eae-811e-b5c33507a73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.952745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f12af4bc-555a-4eae-811e-b5c33507a73b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:26.953930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f12af4bc-555a-4eae-811e-b5c33507a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:26.970664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6fbb6-9abc-43ca-842c-22119404aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:26.971526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6fbb6-9abc-43ca-842c-22119404aa21 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:26.971813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6fbb6-9abc-43ca-842c-22119404aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:26.972094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6fbb6-9abc-43ca-842c-22119404aa21 None admin] PATH_INFO: `/v3/projects/49a1ec22021e42d1aa1d63a70d01395f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:26.973284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6fbb6-9abc-43ca-842c-22119404aa21 None admin] RBAC: Authorizing `identity:get_project(project_id=49a1ec22021e42d1aa1d63a70d01395f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:26.974764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6fbb6-9abc-43ca-842c-22119404aa21 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:26.980673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 212/435] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:26 2022] GET /identity/v3/projects/49a1ec22021e42d1aa1d63a70d01395f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:26.980673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6fbb6-9abc-43ca-842c-22119404aa21 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.025416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 224/436] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:27.034767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12af4bc-555a-4eae-811e-b5c33507a73b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.095975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6fbb6-9abc-43ca-842c-22119404aa21 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.126033 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12af4bc-555a-4eae-811e-b5c33507a73b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.128369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf04507-eda4-4af6-9298-1d2eb239fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.129224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04507-eda4-4af6-9298-1d2eb239fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.129511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04507-eda4-4af6-9298-1d2eb239fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.129788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf04507-eda4-4af6-9298-1d2eb239fbdd None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.131099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf04507-eda4-4af6-9298-1d2eb239fbdd None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:27.132566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf04507-eda4-4af6-9298-1d2eb239fbdd None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:27.138656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 213/437] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:26 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:27.138656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf04507-eda4-4af6-9298-1d2eb239fbdd None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.166129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba7fbb-2840-498d-b5b7-3f7f3f3d05cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.167192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7fbb-2840-498d-b5b7-3f7f3f3d05cd None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.168742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7fbb-2840-498d-b5b7-3f7f3f3d05cd None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.169033 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba7fbb-2840-498d-b5b7-3f7f3f3d05cd None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.170226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba7fbb-2840-498d-b5b7-3f7f3f3d05cd None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:27.171706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba7fbb-2840-498d-b5b7-3f7f3f3d05cd None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:27.178594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 225/438] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:27.178594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba7fbb-2840-498d-b5b7-3f7f3f3d05cd None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.229733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf04507-eda4-4af6-9298-1d2eb239fbdd None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.271337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d471b-49a6-4698-8060-ca4e07b231dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.272268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d471b-49a6-4698-8060-ca4e07b231dc None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.272550 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d471b-49a6-4698-8060-ca4e07b231dc None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.272829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d471b-49a6-4698-8060-ca4e07b231dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.284121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba7fbb-2840-498d-b5b7-3f7f3f3d05cd None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.286572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d471b-49a6-4698-8060-ca4e07b231dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:27.297007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-e71d471b-49a6-4698-8060-ca4e07b231dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:19:27.306854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 214/439] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:27.306854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d471b-49a6-4698-8060-ca4e07b231dc None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.326123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67323a2e-9a2f-4dca-92ee-0097cc915d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.327016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67323a2e-9a2f-4dca-92ee-0097cc915d1f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.327302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67323a2e-9a2f-4dca-92ee-0097cc915d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.327579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67323a2e-9a2f-4dca-92ee-0097cc915d1f None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.328763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67323a2e-9a2f-4dca-92ee-0097cc915d1f None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:27.330192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67323a2e-9a2f-4dca-92ee-0097cc915d1f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:27.331836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 226/440] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:27.332586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67323a2e-9a2f-4dca-92ee-0097cc915d1f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.419977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d471b-49a6-4698-8060-ca4e07b231dc None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.434034 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67323a2e-9a2f-4dca-92ee-0097cc915d1f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.455983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.456640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.456926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.457212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.458051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] RBAC: Adding query filter params (group.id=f761abe630444ee298f7b6dac5aa7568, role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=49a1ec22021e42d1aa1d63a70d01395f) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:27.458368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:27.459838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:27.465969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 215/441] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/role_assignments?group.id=f761abe630444ee298f7b6dac5aa7568&scope.project.id=49a1ec22021e42d1aa1d63a70d01395f&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:27.466762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.466863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f64e9f-1980-4749-8515-91508b4d685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.467554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f64e9f-1980-4749-8515-91508b4d685a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.467845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f64e9f-1980-4749-8515-91508b4d685a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.468122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f64e9f-1980-4749-8515-91508b4d685a None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.468875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f64e9f-1980-4749-8515-91508b4d685a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:27.469188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f64e9f-1980-4749-8515-91508b4d685a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:27.470603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f64e9f-1980-4749-8515-91508b4d685a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:27.484611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 227/442] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:27.484611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316996c-1175-4312-aac7-aabd2ab51f7f None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.484611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316996c-1175-4312-aac7-aabd2ab51f7f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.484611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316996c-1175-4312-aac7-aabd2ab51f7f None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.484611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 228/443] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:27.485686 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316996c-1175-4312-aac7-aabd2ab51f7f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.570745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e99fc-d80a-4728-b7d8-2a052a91fb95 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.592973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316996c-1175-4312-aac7-aabd2ab51f7f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.607341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b9e76-449f-4212-8971-69420fd8551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.608036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9e76-449f-4212-8971-69420fd8551b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.608320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9e76-449f-4212-8971-69420fd8551b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.608600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9e76-449f-4212-8971-69420fd8551b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.609456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b9e76-449f-4212-8971-69420fd8551b None admin] RBAC: Adding query filter params (group.id=f761abe630444ee298f7b6dac5aa7568, role.id=fbf12d23efc946bdaacd8b4b123dd3fc, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:27.609794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b9e76-449f-4212-8971-69420fd8551b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:27.611308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b9e76-449f-4212-8971-69420fd8551b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:27.617726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 216/444] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/role_assignments?group.id=f761abe630444ee298f7b6dac5aa7568&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=fbf12d23efc946bdaacd8b4b123dd3fc => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:27.618987 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd786f-482d-4d93-9d4d-8d66a3946ae5 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.619275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd786f-482d-4d93-9d4d-8d66a3946ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.619578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd786f-482d-4d93-9d4d-8d66a3946ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.639799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f1bd786f-482d-4d93-9d4d-8d66a3946ae5 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:27.641053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f1bd786f-482d-4d93-9d4d-8d66a3946ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:27.641571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6beddc-18a7-4798-a518-2b46a060d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.642603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6beddc-18a7-4798-a518-2b46a060d363 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.643126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6beddc-18a7-4798-a518-2b46a060d363 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.643935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6beddc-18a7-4798-a518-2b46a060d363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.733489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6beddc-18a7-4798-a518-2b46a060d363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:27.734967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6beddc-18a7-4798-a518-2b46a060d363 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:27.740317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 217/445] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:27.763017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd786f-482d-4d93-9d4d-8d66a3946ae5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.849400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 229/446] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:27.855237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6beddc-18a7-4798-a518-2b46a060d363 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.890568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd786f-482d-4d93-9d4d-8d66a3946ae5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:27.931574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088eb79-5daf-4968-8a61-2829121aa7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:27.932382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088eb79-5daf-4968-8a61-2829121aa7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:27.933687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088eb79-5daf-4968-8a61-2829121aa7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:27.933687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088eb79-5daf-4968-8a61-2829121aa7a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:27.950865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088eb79-5daf-4968-8a61-2829121aa7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:27.963007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-8088eb79-5daf-4968-8a61-2829121aa7a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:19:27.964444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 218/447] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:27.970487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088eb79-5daf-4968-8a61-2829121aa7a8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:27.979403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6beddc-18a7-4798-a518-2b46a060d363 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:28.027154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e628b3e-1461-4aa5-b880-4f4bb60864de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:28.028941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628b3e-1461-4aa5-b880-4f4bb60864de None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:28.028941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628b3e-1461-4aa5-b880-4f4bb60864de None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:28.028941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628b3e-1461-4aa5-b880-4f4bb60864de None admin] PATH_INFO: `/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:28.030096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e628b3e-1461-4aa5-b880-4f4bb60864de None admin] RBAC: Authorizing `identity:get_project(project_id=06dd0f86b47846d2aa207c0f5574fbd6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:28.031720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e628b3e-1461-4aa5-b880-4f4bb60864de None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:28.037728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 230/448] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/projects/06dd0f86b47846d2aa207c0f5574fbd6 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:28.040372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e628b3e-1461-4aa5-b880-4f4bb60864de None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:28.092968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088eb79-5daf-4968-8a61-2829121aa7a8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:28.125665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:28.126336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:28.126661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:28.126943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:28.127696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:28.128004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:28.129375 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:28.137808 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 219/449] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:28.143327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:28.143445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e628b3e-1461-4aa5-b880-4f4bb60864de None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:28.175280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b67fc-c031-4bb6-939a-e301a06654d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:28.176185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b67fc-c031-4bb6-939a-e301a06654d2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:28.176470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b67fc-c031-4bb6-939a-e301a06654d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:28.176769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b67fc-c031-4bb6-939a-e301a06654d2 None admin] PATH_INFO: `/v3/groups/f761abe630444ee298f7b6dac5aa7568` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:28.177952 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b67fc-c031-4bb6-939a-e301a06654d2 None admin] RBAC: Authorizing `identity:get_group(group_id=f761abe630444ee298f7b6dac5aa7568)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:28.179666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b67fc-c031-4bb6-939a-e301a06654d2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:28.181273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 231/450] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:28 2022] GET /identity/v3/groups/f761abe630444ee298f7b6dac5aa7568 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:28.187422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b67fc-c031-4bb6-939a-e301a06654d2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:28.234240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded21f8-10ba-490f-9aa5-d785d802ca51 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:28.265915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318d467-a6d4-4daf-a34e-0644024bdfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:28.266525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d467-a6d4-4daf-a34e-0644024bdfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:28.266838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d467-a6d4-4daf-a34e-0644024bdfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:28.267118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318d467-a6d4-4daf-a34e-0644024bdfe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:28.279963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b67fc-c031-4bb6-939a-e301a06654d2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:28.312467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:28.313121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:28.313408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:28.313690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:28.314529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] RBAC: Adding query filter params (group.id=f761abe630444ee298f7b6dac5aa7568, role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:28.314878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:28.316325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:28.322177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 232/451] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:28 2022] GET /identity/v3/role_assignments?group.id=f761abe630444ee298f7b6dac5aa7568&scope.project.id=06dd0f86b47846d2aa207c0f5574fbd6&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:28.344825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318d467-a6d4-4daf-a34e-0644024bdfe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:28.346315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318d467-a6d4-4daf-a34e-0644024bdfe3 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:28.447243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 220/452] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 16:19:28.453027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:28.551832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3abf6c-e3c6-4816-83e6-a2079441d04b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:28.584624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adf3cf-3f36-4980-a402-09e29d54d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:28.585538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adf3cf-3f36-4980-a402-09e29d54d0ff None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:28.585828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adf3cf-3f36-4980-a402-09e29d54d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:28.586103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adf3cf-3f36-4980-a402-09e29d54d0ff None admin] PATH_INFO: `/v3/projects/0143687fa93942b783a5884094e78824` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:28.587423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adf3cf-3f36-4980-a402-09e29d54d0ff None admin] RBAC: Authorizing `identity:get_project(project_id=0143687fa93942b783a5884094e78824)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:28.588886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adf3cf-3f36-4980-a402-09e29d54d0ff None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:28.590796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 233/453] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:19:28 2022] GET /identity/v3/projects/0143687fa93942b783a5884094e78824 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:28.596154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318d467-a6d4-4daf-a34e-0644024bdfe3 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:28.695080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318d467-a6d4-4daf-a34e-0644024bdfe3 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:28.726970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407523-4075-4f9b-ab53-ba27120b419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:28.727820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407523-4075-4f9b-ab53-ba27120b419f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:28.728110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407523-4075-4f9b-ab53-ba27120b419f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:28.728388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407523-4075-4f9b-ab53-ba27120b419f None admin] PATH_INFO: `/v3/groups/0c85443895cd4db6a7201719ea0c4fe6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:28.729551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407523-4075-4f9b-ab53-ba27120b419f None admin] RBAC: Authorizing `identity:get_group(group_id=0c85443895cd4db6a7201719ea0c4fe6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:28.731609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407523-4075-4f9b-ab53-ba27120b419f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:28.733224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 221/454] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Apr 28 16:19:28 2022] GET /identity/v3/groups/0c85443895cd4db6a7201719ea0c4fe6 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:28.738960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adf3cf-3f36-4980-a402-09e29d54d0ff None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:28.830797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adf3cf-3f36-4980-a402-09e29d54d0ff None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:28.862168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fda6c-94f1-4e82-af8a-47be95d78bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:28.862842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fda6c-94f1-4e82-af8a-47be95d78bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:28.863126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fda6c-94f1-4e82-af8a-47be95d78bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:28.863402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fda6c-94f1-4e82-af8a-47be95d78bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:28.864227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fda6c-94f1-4e82-af8a-47be95d78bc4 None admin] RBAC: Adding query filter params (group.id=0c85443895cd4db6a7201719ea0c4fe6, role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=0143687fa93942b783a5884094e78824) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:28.864535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fda6c-94f1-4e82-af8a-47be95d78bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:28.865976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fda6c-94f1-4e82-af8a-47be95d78bc4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:28.871567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 234/455] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Apr 28 16:19:28 2022] GET /identity/v3/role_assignments?group.id=0c85443895cd4db6a7201719ea0c4fe6&scope.project.id=0143687fa93942b783a5884094e78824&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:31.623804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e409-288d-4d03-bfb5-95220b54a9e0 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:31.624831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e409-288d-4d03-bfb5-95220b54a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:31.625322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e409-288d-4d03-bfb5-95220b54a9e0 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:31.627210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 222/456] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:31.640407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc042-3b24-41ee-bce4-85dffc7c3b2b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:31.641229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc042-3b24-41ee-bce4-85dffc7c3b2b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:31.641659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc042-3b24-41ee-bce4-85dffc7c3b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:31.671661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-404bc042-3b24-41ee-bce4-85dffc7c3b2b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:31.673220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-404bc042-3b24-41ee-bce4-85dffc7c3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:31.758932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 235/457] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:31.791614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580e409-288d-4d03-bfb5-95220b54a9e0 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:31.940278 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580e409-288d-4d03-bfb5-95220b54a9e0 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:31.976180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542451-41a9-44a4-8404-2346f44e44f1 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:31.976834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542451-41a9-44a4-8404-2346f44e44f1 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:31.977314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542451-41a9-44a4-8404-2346f44e44f1 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:31.979201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 236/458] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:31.979304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:31.980160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:31.980453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:31.980731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:31.983962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a973a-53d2-4256-8522-9eead4ba0815 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:31.984482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a973a-53d2-4256-8522-9eead4ba0815 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:31.984975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a973a-53d2-4256-8522-9eead4ba0815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:31.991531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:31.992975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:32.010785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:32.012330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 223/459] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:32.018165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e72a973a-53d2-4256-8522-9eead4ba0815 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:32.018429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:32.019506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e72a973a-53d2-4256-8522-9eead4ba0815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:32.138146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665f147-dd16-4d3c-96bf-33306650db8c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:32.176528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:32.177470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.177903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.179582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.180466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:32.181102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:32.183756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:32.204268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 237/460] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:32.206717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 224/461] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:32.212407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a973a-53d2-4256-8522-9eead4ba0815 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:32.257408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:32.352707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a973a-53d2-4256-8522-9eead4ba0815 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:32.375848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c6747-16df-415c-a45b-5acf04ebc447 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:32.386930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8a244-bdfb-46c2-be0e-87927979b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:32.387604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a244-bdfb-46c2-be0e-87927979b5aa None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.387892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a244-bdfb-46c2-be0e-87927979b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.388197 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a244-bdfb-46c2-be0e-87927979b5aa None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.388903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8a244-bdfb-46c2-be0e-87927979b5aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:32.390359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8a244-bdfb-46c2-be0e-87927979b5aa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:32.407058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5630-f1ab-4c20-809b-266f42128d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:32.407852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5630-f1ab-4c20-809b-266f42128d3c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.408138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5630-f1ab-4c20-809b-266f42128d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.408412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5630-f1ab-4c20-809b-266f42128d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.418382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa5630-f1ab-4c20-809b-266f42128d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:32.420338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa5630-f1ab-4c20-809b-266f42128d3c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:32.436946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-f0aa5630-f1ab-4c20-809b-266f42128d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:32.438141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 225/462] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:32.439352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045eed-92da-4b8e-9284-b9a189990e1f None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.439638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045eed-92da-4b8e-9284-b9a189990e1f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.439909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045eed-92da-4b8e-9284-b9a189990e1f None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.441200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 226/463] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:32.442256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de80c-5664-4ada-99ba-9e09b756a2b5 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.442565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de80c-5664-4ada-99ba-9e09b756a2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.442982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de80c-5664-4ada-99ba-9e09b756a2b5 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.446575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 227/464] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:32.446575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033de80c-5664-4ada-99ba-9e09b756a2b5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:32.512668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 238/465] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:19:32 2022] POST /identity/v3/users => generated 246 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:32.514442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77a942-d34d-4fa5-8609-660075ae8533 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.514955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77a942-d34d-4fa5-8609-660075ae8533 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.515432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77a942-d34d-4fa5-8609-660075ae8533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.540276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ba77a942-d34d-4fa5-8609-660075ae8533 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:32.542043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ba77a942-d34d-4fa5-8609-660075ae8533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:32.549507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033de80c-5664-4ada-99ba-9e09b756a2b5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:32.585916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72badb3-a984-4e4b-82a1-fddbedaaaa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:32.586768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72badb3-a984-4e4b-82a1-fddbedaaaa1f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.587057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72badb3-a984-4e4b-82a1-fddbedaaaa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.587336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72badb3-a984-4e4b-82a1-fddbedaaaa1f None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.588156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72badb3-a984-4e4b-82a1-fddbedaaaa1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:32.588470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72badb3-a984-4e4b-82a1-fddbedaaaa1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:32.590143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72badb3-a984-4e4b-82a1-fddbedaaaa1f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:32.609698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 228/466] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:32.609698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c150-9e4e-4112-a24d-3f4f98b13262 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.609698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c150-9e4e-4112-a24d-3f4f98b13262 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.609698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c150-9e4e-4112-a24d-3f4f98b13262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.626422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b074c150-9e4e-4112-a24d-3f4f98b13262 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:32.627546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b074c150-9e4e-4112-a24d-3f4f98b13262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:32.638988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 239/467] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:32.640291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77a942-d34d-4fa5-8609-660075ae8533 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:32.699772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 229/468] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:32.700472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c150-9e4e-4112-a24d-3f4f98b13262 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:32.765241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77a942-d34d-4fa5-8609-660075ae8533 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:32.801503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f682ae4-27d7-41e0-9ab4-212d8e6b3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:32.802191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f682ae4-27d7-41e0-9ab4-212d8e6b3f20 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.802471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f682ae4-27d7-41e0-9ab4-212d8e6b3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.802777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f682ae4-27d7-41e0-9ab4-212d8e6b3f20 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.803184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c150-9e4e-4112-a24d-3f4f98b13262 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:32.803790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f682ae4-27d7-41e0-9ab4-212d8e6b3f20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:32.805230 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f682ae4-27d7-41e0-9ab4-212d8e6b3f20 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:32.837795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:32.838634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.838924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.839202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.849733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:32.851263 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:32.868544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:32.869740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 230/469] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:32.870503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:32.930582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 240/470] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:19:32 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:32.930582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40aab9-0efe-41ef-ac9b-c73280fc03e9 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:32.930582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40aab9-0efe-41ef-ac9b-c73280fc03e9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:32.930582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40aab9-0efe-41ef-ac9b-c73280fc03e9 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:32.930582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 241/471] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:32.930582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40aab9-0efe-41ef-ac9b-c73280fc03e9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:32.994694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8828d2-6a66-430e-9881-07e512c9386e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:33.053457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a7118-e806-45eb-b50e-8dcfe05167b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:33.055141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7118-e806-45eb-b50e-8dcfe05167b0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.055723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7118-e806-45eb-b50e-8dcfe05167b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.056147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a7118-e806-45eb-b50e-8dcfe05167b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.061324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40aab9-0efe-41ef-ac9b-c73280fc03e9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:33.070308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a7118-e806-45eb-b50e-8dcfe05167b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:33.072496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a7118-e806-45eb-b50e-8dcfe05167b0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:33.097039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-fa8a7118-e806-45eb-b50e-8dcfe05167b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:33.103419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 231/472] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:33.104185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031792c-3fc3-4905-876c-5ead1f8a6199 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.104478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031792c-3fc3-4905-876c-5ead1f8a6199 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.104789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031792c-3fc3-4905-876c-5ead1f8a6199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.106946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:33.107627 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.107916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.108195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.108948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:33.109263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:33.110721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:33.131497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e031792c-3fc3-4905-876c-5ead1f8a6199 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:33.133067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e031792c-3fc3-4905-876c-5ead1f8a6199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:33.136328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 242/473] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:33.137253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:33.216363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 232/474] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:33.217470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031792c-3fc3-4905-876c-5ead1f8a6199 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:33.262564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93261caa-0625-4418-a726-9e9769540f9f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:33.295876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:33.296560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.296833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.297114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.297902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:33.298215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:33.299755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:33.312722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 243/475] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:33.313669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:33.337078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031792c-3fc3-4905-876c-5ead1f8a6199 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:33.370884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea26518-2d1a-46b0-a8e1-a4f634197409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:33.371618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea26518-2d1a-46b0-a8e1-a4f634197409 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.371912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea26518-2d1a-46b0-a8e1-a4f634197409 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.372191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea26518-2d1a-46b0-a8e1-a4f634197409 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.373412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea26518-2d1a-46b0-a8e1-a4f634197409 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:33.374891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea26518-2d1a-46b0-a8e1-a4f634197409 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:33.424767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20918c-0215-4917-8dc9-47a52637a3a9 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:33.460801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:33.461540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.461838 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.462123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.462973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:33.464466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:33.470666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 233/476] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:19:33 2022] POST /identity/v3/users => generated 249 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:33.472047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea26518-2d1a-46b0-a8e1-a4f634197409 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:33.508341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.sql.core [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 28 16:19:33.508341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 28 16:19:33.508341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [parameters: {'id': 'a867e5391d9742fc9e8bfb42b361f198', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 28 16:19:33.508341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80049) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 28 16:19:33.534107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 28 16:19:33.538086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 244/477] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Apr 28 16:19:33 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:33.544373 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:33.669058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea26518-2d1a-46b0-a8e1-a4f634197409 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:33.704126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c23068-fba1-456c-a1c2-dd90a6969a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:33.704809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23068-fba1-456c-a1c2-dd90a6969a85 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.705093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23068-fba1-456c-a1c2-dd90a6969a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.705370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23068-fba1-456c-a1c2-dd90a6969a85 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.706080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c23068-fba1-456c-a1c2-dd90a6969a85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:33.707696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c23068-fba1-456c-a1c2-dd90a6969a85 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:33.714728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7d2e6-76f1-43cc-9daa-dab8fe75f123 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:33.750700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec084b5-46a2-41dc-9051-67b503db6b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:33.751533 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec084b5-46a2-41dc-9051-67b503db6b6b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.751821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec084b5-46a2-41dc-9051-67b503db6b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.752101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec084b5-46a2-41dc-9051-67b503db6b6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.764203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec084b5-46a2-41dc-9051-67b503db6b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:33.772185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-3ec084b5-46a2-41dc-9051-67b503db6b6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 28 16:19:33.773891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 245/478] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:19:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:33.779545 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec084b5-46a2-41dc-9051-67b503db6b6b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:33.789296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 234/479] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:19:33 2022] POST /identity/v3/users => generated 248 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:33.897780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec084b5-46a2-41dc-9051-67b503db6b6b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:33.941888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275691ca-38e3-493b-8e45-dd3db704ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:33.942495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275691ca-38e3-493b-8e45-dd3db704ff20 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:33.942804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275691ca-38e3-493b-8e45-dd3db704ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:33.943084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275691ca-38e3-493b-8e45-dd3db704ff20 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:33.943849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275691ca-38e3-493b-8e45-dd3db704ff20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:33.944158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275691ca-38e3-493b-8e45-dd3db704ff20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:33.945553 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275691ca-38e3-493b-8e45-dd3db704ff20 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:33.956896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 246/480] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:35.237822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb767-3d76-47dd-bfb0-bc8c56d60124 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:35.238916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb767-3d76-47dd-bfb0-bc8c56d60124 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:35.239425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb767-3d76-47dd-bfb0-bc8c56d60124 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:35.241137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 235/481] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:35.256344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096cff-5073-42e3-9d57-bdd2a581ed75 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:35.257269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096cff-5073-42e3-9d57-bdd2a581ed75 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:35.257750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37096cff-5073-42e3-9d57-bdd2a581ed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:35.283639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-37096cff-5073-42e3-9d57-bdd2a581ed75 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:35.285208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-37096cff-5073-42e3-9d57-bdd2a581ed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:35.370962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 247/482] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:35.409762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab38f-1310-4dc9-92fb-2834459cac25 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:35.409762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab38f-1310-4dc9-92fb-2834459cac25 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:35.409762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab38f-1310-4dc9-92fb-2834459cac25 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:35.410463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 236/483] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:35.415112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37096cff-5073-42e3-9d57-bdd2a581ed75 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:35.415982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780fe5-40a0-4b00-8973-fa88f671f291 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:35.416480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780fe5-40a0-4b00-8973-fa88f671f291 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:35.416963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89780fe5-40a0-4b00-8973-fa88f671f291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:35.438126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-89780fe5-40a0-4b00-8973-fa88f671f291 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:35.439846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-89780fe5-40a0-4b00-8973-fa88f671f291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:35.517471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 237/484] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:35.544275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89780fe5-40a0-4b00-8973-fa88f671f291 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:35.606215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37096cff-5073-42e3-9d57-bdd2a581ed75 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:35.660252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89780fe5-40a0-4b00-8973-fa88f671f291 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:35.689899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d1de-e7df-471b-80d3-c1045f21fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:35.690942 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d1de-e7df-471b-80d3-c1045f21fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:35.691391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d1de-e7df-471b-80d3-c1045f21fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:35.691807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d1de-e7df-471b-80d3-c1045f21fbd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:35.707959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193132-fad1-4d2d-823e-4acc0f8026f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:35.708765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193132-fad1-4d2d-823e-4acc0f8026f9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:35.709053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193132-fad1-4d2d-823e-4acc0f8026f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:35.709335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193132-fad1-4d2d-823e-4acc0f8026f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:35.716799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50d1de-e7df-471b-80d3-c1045f21fbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:35.723979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-8a50d1de-e7df-471b-80d3-c1045f21fbd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:35.725210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 248/485] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:35.731443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c193132-fad1-4d2d-823e-4acc0f8026f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:35.738592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-3c193132-fad1-4d2d-823e-4acc0f8026f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:35.739812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 238/486] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:35.740730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d1de-e7df-471b-80d3-c1045f21fbd3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:35.753916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193132-fad1-4d2d-823e-4acc0f8026f9 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:35.866747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d1de-e7df-471b-80d3-c1045f21fbd3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:35.904408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:35.905091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:35.905384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:35.905671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:35.906435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:35.906919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:35.908325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:35.917579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 249/487] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:35.923558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:35.982768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c193132-fad1-4d2d-823e-4acc0f8026f9 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:36.055379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:36.056099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.056390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.056673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.057455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:36.057769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:36.059324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:36.076834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbb0f1-9265-4a02-96e6-13d20d4ac689 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:36.086432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 239/488] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:36.099646 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:36.117776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:36.119005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.119497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.119970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.131758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:36.133501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:36.150640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:36.152425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 250/489] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:36.157944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:36.298592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe4357-2e51-44ad-9fd3-3c8cc08a083a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:36.343309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9878ad2-615a-4b03-897e-fd324e3ed3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:36.344110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878ad2-615a-4b03-897e-fd324e3ed3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.344467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878ad2-615a-4b03-897e-fd324e3ed3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.344815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878ad2-615a-4b03-897e-fd324e3ed3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.345624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9878ad2-615a-4b03-897e-fd324e3ed3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:36.346003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9878ad2-615a-4b03-897e-fd324e3ed3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:36.347640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9878ad2-615a-4b03-897e-fd324e3ed3f4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:36.365279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 251/490] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:36.371020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd769-2e05-4fb1-b669-fdd380e6391a None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.371389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd769-2e05-4fb1-b669-fdd380e6391a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.371764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd769-2e05-4fb1-b669-fdd380e6391a None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.377172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 252/491] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:36.377172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dd769-2e05-4fb1-b669-fdd380e6391a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:36.437137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8761a5-a775-4143-96cf-f6db4912bda8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:36.473893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0a994-b7e7-48d8-9fb4-5dfc9640543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:36.475172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0a994-b7e7-48d8-9fb4-5dfc9640543f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.475721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0a994-b7e7-48d8-9fb4-5dfc9640543f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.476199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0a994-b7e7-48d8-9fb4-5dfc9640543f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.488140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0a994-b7e7-48d8-9fb4-5dfc9640543f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:36.489905 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0a994-b7e7-48d8-9fb4-5dfc9640543f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:36.510665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-43c0a994-b7e7-48d8-9fb4-5dfc9640543f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:36.512716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 240/492] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:36.514303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d56f0b-2e1b-4a47-9345-9d1fc7c5fc8f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.514859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d56f0b-2e1b-4a47-9345-9d1fc7c5fc8f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.515343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d56f0b-2e1b-4a47-9345-9d1fc7c5fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.536937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-07d56f0b-2e1b-4a47-9345-9d1fc7c5fc8f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:36.538488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-07d56f0b-2e1b-4a47-9345-9d1fc7c5fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:36.589621 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dd769-2e05-4fb1-b669-fdd380e6391a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:36.614930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 241/493] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:36.616330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d56f0b-2e1b-4a47-9345-9d1fc7c5fc8f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:36.665808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:36.668950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.669306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.669594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.685162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:36.686662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:36.710781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:19:36.723590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 253/494] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:19:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:36.724470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:36.746093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d56f0b-2e1b-4a47-9345-9d1fc7c5fc8f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:36.782529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:36.783647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.784179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.787101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.792594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:36.793256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:36.795169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:36.809284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 242/495] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:36.810502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:36.872611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d840a-3f08-46bb-9e20-f38a36be65d0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:36.904654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2dd37-5e79-4bd2-a1c4-6eb4648110db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:36.905188 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf469d0-bcd4-4c03-a095-dac30abe22f7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:36.905460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2dd37-5e79-4bd2-a1c4-6eb4648110db None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.905747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2dd37-5e79-4bd2-a1c4-6eb4648110db None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.906026 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2dd37-5e79-4bd2-a1c4-6eb4648110db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.915671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2dd37-5e79-4bd2-a1c4-6eb4648110db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:36.923221 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-66e2dd37-5e79-4bd2-a1c4-6eb4648110db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:36.924417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 254/496] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:36.925182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2dd37-5e79-4bd2-a1c4-6eb4648110db None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:36.937192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a53fad-32ae-46c5-b087-d81306c1cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:36.937864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53fad-32ae-46c5-b087-d81306c1cb6e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.938149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53fad-32ae-46c5-b087-d81306c1cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.938435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53fad-32ae-46c5-b087-d81306c1cb6e None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.939329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a53fad-32ae-46c5-b087-d81306c1cb6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:36.939706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a53fad-32ae-46c5-b087-d81306c1cb6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:36.941088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a53fad-32ae-46c5-b087-d81306c1cb6e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:36.976426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 243/497] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:19:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:36.977695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a6e0-2414-46e5-8777-0a0a7bf2468a None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.977989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a6e0-2414-46e5-8777-0a0a7bf2468a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.978277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a6e0-2414-46e5-8777-0a0a7bf2468a None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.979553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 244/498] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:36.982345 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde9e9-51c7-4d39-929c-6634173dddb0 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:36.982705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde9e9-51c7-4d39-929c-6634173dddb0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:36.982987 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde9e9-51c7-4d39-929c-6634173dddb0 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:36.984408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 245/499] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:36.985113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde9e9-51c7-4d39-929c-6634173dddb0 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.021336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2dd37-5e79-4bd2-a1c4-6eb4648110db None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.054815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.055617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.055904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.056180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.064019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.065490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.079680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 28 16:19:37.081276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 255/500] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:37.081683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.096542 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde9e9-51c7-4d39-929c-6634173dddb0 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.129213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c7a4-3b55-44e9-8ae4-0876c0c53fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.129811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c7a4-3b55-44e9-8ae4-0876c0c53fca None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.130091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c7a4-3b55-44e9-8ae4-0876c0c53fca None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.130368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c7a4-3b55-44e9-8ae4-0876c0c53fca None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.131174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c7a4-3b55-44e9-8ae4-0876c0c53fca None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:37.131482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c7a4-3b55-44e9-8ae4-0876c0c53fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.132850 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c7a4-3b55-44e9-8ae4-0876c0c53fca None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.140886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 246/501] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:37.142021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca5b1-d8ce-4ed0-b46d-3ae56a8dc07e None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.142306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca5b1-d8ce-4ed0-b46d-3ae56a8dc07e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.142606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ca5b1-d8ce-4ed0-b46d-3ae56a8dc07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.157786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3e4ca5b1-d8ce-4ed0-b46d-3ae56a8dc07e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:37.159040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3e4ca5b1-d8ce-4ed0-b46d-3ae56a8dc07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:37.175915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34561a-9cef-4f9b-a832-5e47351ed48c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.208285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b674f-25c0-4ac9-bb81-512769604c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.208927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b674f-25c0-4ac9-bb81-512769604c02 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.209214 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b674f-25c0-4ac9-bb81-512769604c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.209490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b674f-25c0-4ac9-bb81-512769604c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.220373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 247/502] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:37.221611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99338b-b9a3-441d-8316-592f82b185e2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.221902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99338b-b9a3-441d-8316-592f82b185e2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.222180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99338b-b9a3-441d-8316-592f82b185e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.237299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1a99338b-b9a3-441d-8316-592f82b185e2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:37.250662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1a99338b-b9a3-441d-8316-592f82b185e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:37.289461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b674f-25c0-4ac9-bb81-512769604c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.291045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b674f-25c0-4ac9-bb81-512769604c02 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.306790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 248/503] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:37.307662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99338b-b9a3-441d-8316-592f82b185e2 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.389103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 256/504] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:37.389886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b674f-25c0-4ac9-bb81-512769604c02 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.407973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99338b-b9a3-441d-8316-592f82b185e2 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.440690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.441351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.441636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.441912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.442789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:37.443098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.444537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.460499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 249/505] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:37.461280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.482802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b674f-25c0-4ac9-bb81-512769604c02 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.514799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.515582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.515867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.516146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.525725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.527231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.543580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:37.545278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 257/506] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:37.546043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.554228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4090993-3af8-4b14-9419-baba7d0b3445 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.586000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.586816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.587114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.587371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.597430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.598896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.615050 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:37.616512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 250/507] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:37.617143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.642895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeae60-4e51-4fb4-a2eb-eab5a93e5566 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.674834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f1359-cd72-4655-84d1-a448923d4378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.675617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1359-cd72-4655-84d1-a448923d4378 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.675904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1359-cd72-4655-84d1-a448923d4378 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.676181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f1359-cd72-4655-84d1-a448923d4378 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.686645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f1359-cd72-4655-84d1-a448923d4378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:37.693666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-d27f1359-cd72-4655-84d1-a448923d4378 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:37.694850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 258/508] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:37.695609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f1359-cd72-4655-84d1-a448923d4378 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.709440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f24a5-65d2-4ec7-b6bf-154a3d7302c0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.746523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.747856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.748140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.748413 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.758903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.760335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.776642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:37.777824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 251/509] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:37.778626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.798958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f1359-cd72-4655-84d1-a448923d4378 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.831222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fc3e3-4758-4e11-90bb-923d78aa4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.831873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fc3e3-4758-4e11-90bb-923d78aa4aab None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.832163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fc3e3-4758-4e11-90bb-923d78aa4aab None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.832439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fc3e3-4758-4e11-90bb-923d78aa4aab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.874999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a75caa-9a2b-4a9d-a044-c31d666c617c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:37.896332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fc3e3-4758-4e11-90bb-923d78aa4aab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.897748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fc3e3-4758-4e11-90bb-923d78aa4aab None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.906086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:37.906788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:37.907069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:37.907347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:37.908070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:37.908377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:37.909736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:37.920839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 252/510] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:37.921613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:37.989786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 259/511] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:37.990641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fc3e3-4758-4e11-90bb-923d78aa4aab None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.012708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e216b-f77e-43fa-8310-601954fb0aa3 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.054717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.055752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.056216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.056685 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.057929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:38.058445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.061250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.078750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 253/512] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:38.080053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.118013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fc3e3-4758-4e11-90bb-923d78aa4aab None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.167106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.168098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.168570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.169544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.170859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:38.171371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.173536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.186303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 260/513] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:38.187474 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.213698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d2b1-d1e6-4c31-8dfd-ff428ecf34f4 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.245013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.245672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.245960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.246239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.246996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:38.247937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.249306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.260624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 254/514] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:38.261324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.280253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76648-cbca-42c4-bcb3-9a2780829ccd None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.313338 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.314125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.314407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.314716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.323070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.324510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.337839 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 28 16:19:38.339212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 261/515] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:38.339787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.354721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60052fa9-c3e7-47c5-b018-0613645f2d8a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.387003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.387839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.388126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.388404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.397918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.399405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.415578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:38.416749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 255/516] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:38.417568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.433299 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aa7f4-e19d-495b-acc3-780732eeb22d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.465091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2552f-9285-44fa-a41b-d1c28ef578a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.465756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2552f-9285-44fa-a41b-d1c28ef578a0 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.466567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2552f-9285-44fa-a41b-d1c28ef578a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.466857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2552f-9285-44fa-a41b-d1c28ef578a0 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.467554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2552f-9285-44fa-a41b-d1c28ef578a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.468989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2552f-9285-44fa-a41b-d1c28ef578a0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.509724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700cbcd-39e2-4e40-9e7d-664ef3a45887 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.531163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 262/517] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:19:38 2022] POST /identity/v3/users => generated 247 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:38.531998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2552f-9285-44fa-a41b-d1c28ef578a0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.542833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.543584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.545974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.545974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.556407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.557999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.577104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:38.583071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 256/518] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:38.583071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.638479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2552f-9285-44fa-a41b-d1c28ef578a0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.673550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.674287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.674597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.674880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.682158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.683671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.686118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b13df-fdae-43dd-a3dd-7a17285739ff None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.697921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:38.703806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 263/519] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:38.703806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.729422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.730088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.730371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.730712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.731613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:38.732446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.733872 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.753535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 257/520] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:38.754386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.801318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a13-c5c6-405f-90f7-eca796d1cb91 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.837085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.837750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.838052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.838320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.839096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:38.839408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.840803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.852629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 264/521] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:38.853465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.862181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82634284-9239-4bae-b40f-0d214255d9ab None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.898446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.899166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.899447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.899717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.900440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:38.900742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.902112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:38.917944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 258/522] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:38.917944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:38.953208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2865a9f-a018-4c8a-8a7b-035e80b2bbc2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:38.986244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:38.986940 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:38.987227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:38.987506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:38.988299 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:38.988618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:38.990059 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.010571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 265/523] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:39.010571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.014051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a7fe-ee4a-4a2e-ac2c-5b865cca32c0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.059161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85857012-1e16-4fb0-9e24-11be66a07fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.059846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85857012-1e16-4fb0-9e24-11be66a07fed None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.060133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85857012-1e16-4fb0-9e24-11be66a07fed None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.060411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85857012-1e16-4fb0-9e24-11be66a07fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.107757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014528ae-b143-473d-bc6e-7ae8825c07c4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.123607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85857012-1e16-4fb0-9e24-11be66a07fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.125050 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85857012-1e16-4fb0-9e24-11be66a07fed None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.140514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.141334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.141595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.141869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.148384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.149842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.163191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:39.168854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 266/524] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:39.168854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.227470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 259/525] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:39.227470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85857012-1e16-4fb0-9e24-11be66a07fed None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.264207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78917f1-3761-4759-8dd8-08397a8b84c3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.298550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.299515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.300013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.300502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.309380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.311391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.324128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85857012-1e16-4fb0-9e24-11be66a07fed None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.325049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 28 16:19:39.327004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 267/526] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:39.327703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.358689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.359350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.359704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.359906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.360750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=5b28dcc32b984429939b95e436b4d41e) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:39.361062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.362504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.368045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 260/527] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/role_assignments?user.id=5b28dcc32b984429939b95e436b4d41e&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:39.368837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.436322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048b632-c2b2-4c78-a5b9-9ff0c3058e23 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.474293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.475392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.475689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582a21f-6572-45ab-ad89-78c175ade58b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.476135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.476620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.477695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:39.478279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.480045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.498973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 268/528] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:39.500256 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.514510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.515250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.515460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.515801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.527290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.528911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.549043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:39.550580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 261/529] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:39.551403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.618904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc12b76-0743-46c7-a8c6-4e465dd09d18 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.653264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.654398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.654909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.655178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e876-71b8-4261-91d8-cf473f5b798f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.655605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.656643 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:39.657144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.658823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.691119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.691804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.692092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.692371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.693244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=9a5c2cf875f8451890e04b97b9686956) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:39.693560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.695199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.705391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 269/530] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:39.706832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.706939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 262/531] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/role_assignments?user.id=9a5c2cf875f8451890e04b97b9686956&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:39.708071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.812514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cf05e-e377-44cb-9b1c-f32c73bdc7d0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.847371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.848381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.848861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.849366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.850368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:39.850898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.852504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:39.865797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 270/532] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:39.873648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35f0a-5db7-401b-8454-4685c967cba6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:39.880177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:39.913475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4db8e9-4342-4039-89a8-199cb8026b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:39.913883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4db8e9-4342-4039-89a8-199cb8026b9e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:39.914172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4db8e9-4342-4039-89a8-199cb8026b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:39.914452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4db8e9-4342-4039-89a8-199cb8026b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:39.987781 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4db8e9-4342-4039-89a8-199cb8026b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:39.989304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4db8e9-4342-4039-89a8-199cb8026b9e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:40.089993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 263/533] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:40.096628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4db8e9-4342-4039-89a8-199cb8026b9e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:40.163462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086c29-b4a7-4502-95e1-1fb2c6d3bf2c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:40.227974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:40.228781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:40.229073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:40.229362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:40.243384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:40.244878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:40.266371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4db8e9-4342-4039-89a8-199cb8026b9e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:40.268897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:40.270679 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 271/534] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:40.276138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:40.315843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:40.316661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:40.317022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:40.317235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:40.342357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:40.343706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:40.371839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:40.379259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 264/535] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:40.388831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:40.398517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48abf5-7772-4528-b5f4-58b50123a23f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:40.448563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:40.450118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:40.451149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:40.451636 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:40.452621 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:40.453124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:40.454763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:40.468171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 272/536] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:40.473491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:40.577148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf1bc2-ffc9-4068-aac3-803566f9ac98 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:40.608799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95361a37-af5a-410a-9f71-93584fd2cd95 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:40.611941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:40.612837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:40.613313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:40.613780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:40.614851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=ebf1f55dbef94868aaac6d39ed70690b) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:40.615382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:40.617097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:40.623327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 273/537] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:40 2022] GET /identity/v3/role_assignments?user.id=ebf1f55dbef94868aaac6d39ed70690b&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:40.662205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:40.663344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:40.663856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:40.664351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:40.665276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:40.665785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:40.667383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:40.689148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 265/538] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:40.694420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:40.812517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db902e49-c9f6-411a-a2ca-b8c6b6db19bd None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:40.851708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173be1-4a90-4dfe-8634-977e257f565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:40.852537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173be1-4a90-4dfe-8634-977e257f565a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:40.852827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173be1-4a90-4dfe-8634-977e257f565a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:40.853108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173be1-4a90-4dfe-8634-977e257f565a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:40.863841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53173be1-4a90-4dfe-8634-977e257f565a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:40.865259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53173be1-4a90-4dfe-8634-977e257f565a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:40.882484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-53173be1-4a90-4dfe-8634-977e257f565a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:40.885085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 274/539] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:40.890515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:40.930563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44383e-dbe7-4885-a185-be21d94e23cb None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:40.931113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44383e-dbe7-4885-a185-be21d94e23cb None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:40.931345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44383e-dbe7-4885-a185-be21d94e23cb None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:40.932875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 275/540] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:40.940038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8b20-d98e-4cb5-be54-fd3e7e204016 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:40.940423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8b20-d98e-4cb5-be54-fd3e7e204016 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:40.940714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c8b20-d98e-4cb5-be54-fd3e7e204016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:40.974476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4e1c8b20-d98e-4cb5-be54-fd3e7e204016 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:40.975855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4e1c8b20-d98e-4cb5-be54-fd3e7e204016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:41.018491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467e44a-4cb2-43f8-ad25-2f9ea1b887a6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:41.082289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:41.082998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:41.083285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:41.083563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:41.084366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:41.084682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:41.086141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:41.109748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 276/541] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:41.125291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 266/542] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:41.130863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c8b20-d98e-4cb5-be54-fd3e7e204016 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:41.158346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:41.276257 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c8b20-d98e-4cb5-be54-fd3e7e204016 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:41.304513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bd87b-7211-43e2-a400-5032c71e04b1 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:41.312260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:41.312888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:41.313181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:41.313467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:41.314306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=63f2a360a89548208edd5fdff1a04e35) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:41.314652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:41.316101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:41.321966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 277/543] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:41 2022] GET /identity/v3/role_assignments?user.id=63f2a360a89548208edd5fdff1a04e35&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:41.340251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478068f5-c8b4-4fc8-baf1-1038de641d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:41.341110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478068f5-c8b4-4fc8-baf1-1038de641d1d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:41.341399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478068f5-c8b4-4fc8-baf1-1038de641d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:41.341681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478068f5-c8b4-4fc8-baf1-1038de641d1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:41.352451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478068f5-c8b4-4fc8-baf1-1038de641d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:41.360824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-478068f5-c8b4-4fc8-baf1-1038de641d1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:41.362449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 267/544] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:41.371772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:41.490473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508060-4b8f-4149-b5d0-445fe00181b9 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:41.531242 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:41.531937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:41.532223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:41.532505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:41.533284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:41.533595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:41.535062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:41.545355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 278/545] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:41.550775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478068f5-c8b4-4fc8-baf1-1038de641d1d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:41.654288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478068f5-c8b4-4fc8-baf1-1038de641d1d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:41.694106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:41.694950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:41.695237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:41.695518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:41.710049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:41.711551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:41.732686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:41.738650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 268/546] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:41.740651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:41.845491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06413e89-9ef6-412e-92b7-d961f736fe98 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:41.893732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09405c-21d6-484f-8d84-8bb3c22422ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:41.894399 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09405c-21d6-484f-8d84-8bb3c22422ab None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:41.894713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09405c-21d6-484f-8d84-8bb3c22422ab None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:41.894994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09405c-21d6-484f-8d84-8bb3c22422ab None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:41.895721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09405c-21d6-484f-8d84-8bb3c22422ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:41.896028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09405c-21d6-484f-8d84-8bb3c22422ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:41.897402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09405c-21d6-484f-8d84-8bb3c22422ab None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:41.915335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 279/547] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:41.920440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:41.942612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a235e-de5d-4e78-b8c4-0f2f8aa91e85 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:41.942612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a235e-de5d-4e78-b8c4-0f2f8aa91e85 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:41.942612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a235e-de5d-4e78-b8c4-0f2f8aa91e85 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:41.943385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 280/548] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:41.948569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579363e-9d78-437d-978b-e22fd7d18c43 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:41.949082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579363e-9d78-437d-978b-e22fd7d18c43 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:41.949663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579363e-9d78-437d-978b-e22fd7d18c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:41.968815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4579363e-9d78-437d-978b-e22fd7d18c43 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:41.970319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4579363e-9d78-437d-978b-e22fd7d18c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:42.087055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 281/549] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:42.115482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579363e-9d78-437d-978b-e22fd7d18c43 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:42.116388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ca9b-43d0-4832-b404-33c15aec36f9 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:42.166708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:42.167524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.167810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.168088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.189192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:42.190715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:42.210821 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 16:19:42.222896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 269/550] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:42.223854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:42.289510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579363e-9d78-437d-978b-e22fd7d18c43 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:42.329976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425fdd4-436d-4db6-b62a-b7c0f8d3be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:42.332726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fdd4-436d-4db6-b62a-b7c0f8d3be8d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.333954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fdd4-436d-4db6-b62a-b7c0f8d3be8d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.337076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fdd4-436d-4db6-b62a-b7c0f8d3be8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.349696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425fdd4-436d-4db6-b62a-b7c0f8d3be8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:42.358311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-5425fdd4-436d-4db6-b62a-b7c0f8d3be8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:42.360322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 282/551] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:42.366414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425fdd4-436d-4db6-b62a-b7c0f8d3be8d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:42.452953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd3dec-06ee-4e6b-95e4-47976c7e7dd2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:42.494310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425fdd4-436d-4db6-b62a-b7c0f8d3be8d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:42.530415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:42.531122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.531408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.531684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.532441 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:42.532747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:42.534127 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:42.536211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed36fc3-9a4e-4fbb-9d8d-c3b42c8b6c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:42.536894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed36fc3-9a4e-4fbb-9d8d-c3b42c8b6c62 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.537176 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed36fc3-9a4e-4fbb-9d8d-c3b42c8b6c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.537453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed36fc3-9a4e-4fbb-9d8d-c3b42c8b6c62 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.538306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed36fc3-9a4e-4fbb-9d8d-c3b42c8b6c62 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:42.538643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed36fc3-9a4e-4fbb-9d8d-c3b42c8b6c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:42.540081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed36fc3-9a4e-4fbb-9d8d-c3b42c8b6c62 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:42.555443 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 283/552] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:42.563218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:42.579861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 270/553] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Apr 28 16:19:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:42.581273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106f0f-b9ad-4200-a323-48bf630d3e4b None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.581513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106f0f-b9ad-4200-a323-48bf630d3e4b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.581794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106f0f-b9ad-4200-a323-48bf630d3e4b None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.587951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 271/554] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:42.588778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106f0f-b9ad-4200-a323-48bf630d3e4b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:42.671330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcebdf-bcca-44fe-84bf-f0f748e165ce None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:42.694617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106f0f-b9ad-4200-a323-48bf630d3e4b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:42.713546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faecff-a066-4f54-a1aa-8e84fdba53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:42.714672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faecff-a066-4f54-a1aa-8e84fdba53ce None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.714966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faecff-a066-4f54-a1aa-8e84fdba53ce None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.715251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faecff-a066-4f54-a1aa-8e84fdba53ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.729652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faecff-a066-4f54-a1aa-8e84fdba53ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:42.730505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085cc8-6b89-4345-9498-65edf57de8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:42.731165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88faecff-a066-4f54-a1aa-8e84fdba53ce None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:42.731353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085cc8-6b89-4345-9498-65edf57de8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.731654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085cc8-6b89-4345-9498-65edf57de8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.731989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60085cc8-6b89-4345-9498-65edf57de8b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.751520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-88faecff-a066-4f54-a1aa-8e84fdba53ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:42.753492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 284/555] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:42.756181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba8d44-cc75-450f-8ce0-c827e51c000f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.756475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba8d44-cc75-450f-8ce0-c827e51c000f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.757612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba8d44-cc75-450f-8ce0-c827e51c000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.779465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-eaba8d44-cc75-450f-8ce0-c827e51c000f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:42.780674 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-eaba8d44-cc75-450f-8ce0-c827e51c000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:42.801432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60085cc8-6b89-4345-9498-65edf57de8b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:42.803210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60085cc8-6b89-4345-9498-65edf57de8b1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:42.848588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 285/556] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:42.849391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba8d44-cc75-450f-8ce0-c827e51c000f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:42.930043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 272/557] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:42.930973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085cc8-6b89-4345-9498-65edf57de8b1 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:42.950194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba8d44-cc75-450f-8ce0-c827e51c000f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:42.985780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:42.986451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:42.986822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:42.987102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:42.987842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:42.988150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:42.989525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.001784 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 286/558] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:43.002633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.041728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60085cc8-6b89-4345-9498-65edf57de8b1 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.074112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8eba2-2096-4c38-be43-0e6e69e460cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.075221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8eba2-2096-4c38-be43-0e6e69e460cd None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.076002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8eba2-2096-4c38-be43-0e6e69e460cd None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.076815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8eba2-2096-4c38-be43-0e6e69e460cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.092401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8eba2-2096-4c38-be43-0e6e69e460cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:43.105069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a4a8eba2-2096-4c38-be43-0e6e69e460cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:43.116594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 273/559] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:43.116594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8eba2-2096-4c38-be43-0e6e69e460cd None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.120544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461032-694c-493c-8e63-feefdeaf2208 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.162294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.163487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.163773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.164052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.178361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.180313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.198394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:43.199905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 287/560] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:43.201172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.235902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8eba2-2096-4c38-be43-0e6e69e460cd None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.282934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.283742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.284032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.284312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.294780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.296570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.310757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e32e13-1699-4e45-923e-f04fbe38eee5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.315725 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:19:43.317322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 274/561] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:43.318286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.346504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.347485 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.347937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.348368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.349289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:43.349807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.351378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.365057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 288/562] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:43.366150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.442446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e64b1-23da-4c48-8450-6033dce5c606 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.476402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4362f-f062-48d5-8a0c-d8143f158d66 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.488462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041784-399f-49ac-810b-430e48434971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.489827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041784-399f-49ac-810b-430e48434971 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.489827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041784-399f-49ac-810b-430e48434971 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.489827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041784-399f-49ac-810b-430e48434971 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.490390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041784-399f-49ac-810b-430e48434971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:43.490732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041784-399f-49ac-810b-430e48434971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.492118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98041784-399f-49ac-810b-430e48434971 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.504895 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 275/563] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:43.505734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041784-399f-49ac-810b-430e48434971 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.516886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8913540-d84d-4b4d-b2b9-817ce92d6500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.517572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8913540-d84d-4b4d-b2b9-817ce92d6500 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.517859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8913540-d84d-4b4d-b2b9-817ce92d6500 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.518139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8913540-d84d-4b4d-b2b9-817ce92d6500 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.519031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8913540-d84d-4b4d-b2b9-817ce92d6500 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:43.519354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8913540-d84d-4b4d-b2b9-817ce92d6500 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.520812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8913540-d84d-4b4d-b2b9-817ce92d6500 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.538620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 289/564] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:43.540008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44687-23f5-47ad-aa6b-b4665444717c None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.540367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44687-23f5-47ad-aa6b-b4665444717c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.540721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44687-23f5-47ad-aa6b-b4665444717c None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.546579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 290/565] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:43.546579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a44687-23f5-47ad-aa6b-b4665444717c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.616828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98041784-399f-49ac-810b-430e48434971 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.643577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a44687-23f5-47ad-aa6b-b4665444717c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.651273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.652068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.652353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.652633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.662357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.663831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.678209 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b265020-4fe6-4924-9202-51e5b500736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.679411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b265020-4fe6-4924-9202-51e5b500736a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.679933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b265020-4fe6-4924-9202-51e5b500736a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.680392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b265020-4fe6-4924-9202-51e5b500736a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.681209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:43.682508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 276/566] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:43.683340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.694280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b265020-4fe6-4924-9202-51e5b500736a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.695874 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b265020-4fe6-4924-9202-51e5b500736a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.709764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-0b265020-4fe6-4924-9202-51e5b500736a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:43.711270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 291/567] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:43.712368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650264-300a-4b36-b9c4-de14c5f4c8d2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.712653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650264-300a-4b36-b9c4-de14c5f4c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.712932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650264-300a-4b36-b9c4-de14c5f4c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.730397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ef650264-300a-4b36-b9c4-de14c5f4c8d2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:43.732171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ef650264-300a-4b36-b9c4-de14c5f4c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:43.797772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292a9e2-d5d9-4d72-a1c2-6c378f97622e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.800163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 292/568] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:43.801008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650264-300a-4b36-b9c4-de14c5f4c8d2 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.847210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.848013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.848297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.848578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.858882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.860314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.876876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:43.878144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 277/569] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:43.878799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.900251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650264-300a-4b36-b9c4-de14c5f4c8d2 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:43.932996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:43.933651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:43.933946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:43.934213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:43.934994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:43.935300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:43.936665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:43.947550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 293/570] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:43.948335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:43.970754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd296a-fdd0-4a2c-9e3f-1766e7732c57 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.002099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb325e3-ef0e-4b9c-9250-7ebeaca41501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.002789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb325e3-ef0e-4b9c-9250-7ebeaca41501 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.003070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb325e3-ef0e-4b9c-9250-7ebeaca41501 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.003346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb325e3-ef0e-4b9c-9250-7ebeaca41501 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.004132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb325e3-ef0e-4b9c-9250-7ebeaca41501 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:44.004439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb325e3-ef0e-4b9c-9250-7ebeaca41501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.005870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb325e3-ef0e-4b9c-9250-7ebeaca41501 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.016591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 278/571] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:44.017790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aced6b-df0f-40cf-a1a2-c35fff7d56b4 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.018081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aced6b-df0f-40cf-a1a2-c35fff7d56b4 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.018411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aced6b-df0f-40cf-a1a2-c35fff7d56b4 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.022023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 279/572] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:44.022023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aced6b-df0f-40cf-a1a2-c35fff7d56b4 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.043720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e98509-4005-479b-9219-ba6139b2a661 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.076556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ece7e-7c3f-44a8-80e5-f9316394484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.077354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ece7e-7c3f-44a8-80e5-f9316394484a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.077642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ece7e-7c3f-44a8-80e5-f9316394484a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.077915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ece7e-7c3f-44a8-80e5-f9316394484a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.087497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ece7e-7c3f-44a8-80e5-f9316394484a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:44.095149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-5f3ece7e-7c3f-44a8-80e5-f9316394484a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:44.096355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 294/573] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:44.097108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ece7e-7c3f-44a8-80e5-f9316394484a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.119149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aced6b-df0f-40cf-a1a2-c35fff7d56b4 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.151138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.151917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.152388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.152881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.154843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:44.155368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.157883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.171628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 280/574] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:44.172427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.194327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ece7e-7c3f-44a8-80e5-f9316394484a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.226576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb60b31-a207-4569-91df-ab17c226e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.227375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60b31-a207-4569-91df-ab17c226e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.227659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60b31-a207-4569-91df-ab17c226e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.227933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60b31-a207-4569-91df-ab17c226e8e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.235302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb60b31-a207-4569-91df-ab17c226e8e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.236736 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb60b31-a207-4569-91df-ab17c226e8e2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.249817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-abb60b31-a207-4569-91df-ab17c226e8e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 28 16:19:44.252923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 295/575] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:44.252923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0b6c-e94a-4b92-9978-8ca606743743 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.252923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0b6c-e94a-4b92-9978-8ca606743743 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.252923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0b6c-e94a-4b92-9978-8ca606743743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.264093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163d476-48a4-4f3d-bf74-39cc492e533e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.268680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-832b0b6c-e94a-4b92-9978-8ca606743743 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:44.269873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-832b0b6c-e94a-4b92-9978-8ca606743743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:44.296259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.296907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.297187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.297464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.298290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=6f397f35533540c6b92f0f4fe220d565) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:44.298687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.300166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.305628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 281/576] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/role_assignments?user.id=6f397f35533540c6b92f0f4fe220d565&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:44.306391 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.336846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 296/577] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:44.337843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0b6c-e94a-4b92-9978-8ca606743743 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.408671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e932b-67ad-4eb0-bc4b-7dbf15a095e0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.440899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0b6c-e94a-4b92-9978-8ca606743743 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.447002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.447694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.447983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.448263 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.449026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:44.449687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.451321 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.464586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 282/578] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:44.464586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.482057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.482896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.483787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.483787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.491670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.493117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.506629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:44.507999 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 297/579] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:44.508773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.557831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ca44-8c53-4ecd-8846-472bf031e16b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.590248 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.590978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.591260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.591535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.592376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:44.592683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.594104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.606088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef9107-d563-4fc1-bef1-4cadf7d6ae05 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.610569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 283/580] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:44.611388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.641732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5272de3-df39-48cd-86b1-8df2649ffc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.642550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5272de3-df39-48cd-86b1-8df2649ffc2a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.642848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5272de3-df39-48cd-86b1-8df2649ffc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.643122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5272de3-df39-48cd-86b1-8df2649ffc2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.652979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5272de3-df39-48cd-86b1-8df2649ffc2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:44.660637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-a5272de3-df39-48cd-86b1-8df2649ffc2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:44.661771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 298/581] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:44.662527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5272de3-df39-48cd-86b1-8df2649ffc2a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.705911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635f99c-26bf-40c9-9dcf-4c18bad14cb1 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.738771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.739563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.739849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.740126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.749698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.751176 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.762650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5272de3-df39-48cd-86b1-8df2649ffc2a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.767285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:44.772968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 284/582] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:44.772968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.799893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.800607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.800891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.801204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.801992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:44.802301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.804037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.819995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 299/583] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:44.819995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.864128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc598e3-77a7-42e9-b4b1-bb8279164f06 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.896376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.897168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.897447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.897723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.907933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.909370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.915177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49f072-9d68-4a59-b7f2-dc87f13e68e1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:44.925770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:44.931620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 285/584] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:44.931620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:44.948166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:44.948829 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:44.949114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:44.949390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:44.950698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:44.951010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:44.952371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:44.960320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 300/585] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:44.961341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.032317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72bb4d-d34d-4960-b75b-10562437617b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.058485 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218d147-20fe-4411-b1ac-81b34af1ece4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.071939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.072605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.072887 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.073161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.073882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:45.074186 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.075644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.091001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 286/586] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:45.091001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.095958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e9e4b-caee-4533-bee6-bd1b16043329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.096854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e9e4b-caee-4533-bee6-bd1b16043329 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.097136 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e9e4b-caee-4533-bee6-bd1b16043329 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.097406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e9e4b-caee-4533-bee6-bd1b16043329 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/5b28dcc32b984429939b95e436b4d41e/roles/b9f6881066644547b4a6bbe662963ab1` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.114849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e9e4b-caee-4533-bee6-bd1b16043329 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=5b28dcc32b984429939b95e436b4d41e, role_id=b9f6881066644547b4a6bbe662963ab1)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.116319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e9e4b-caee-4533-bee6-bd1b16043329 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.187887 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6fa18-3742-4e5b-a7cd-20315bf552ed None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.203557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 301/587] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:19:44 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/5b28dcc32b984429939b95e436b4d41e/roles/b9f6881066644547b4a6bbe662963ab1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:45.204595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e9e4b-caee-4533-bee6-bd1b16043329 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.235561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.236570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.237002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.237422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.238436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:45.238930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.240494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.258795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 287/588] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:45.258795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.356984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e9e4b-caee-4533-bee6-bd1b16043329 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.393649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7365691-82e3-4d67-bd89-eeeec113d75a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.396518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.397575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.398082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.398580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.410054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.411873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.428899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.429726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.430014 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.430295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.432069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:45.433922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 302/589] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:45.435708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.439508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.440956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.456544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 28 16:19:45.458091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 288/590] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:45.461961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.545430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb16f1f-eff1-45f7-8cc7-b6889da8395d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.559264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d4d03-b384-4899-8825-3a2ef637f040 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.581651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.582836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.583356 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.583847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.591246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.593097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.593522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.594181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.594475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.594789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.595523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:45.595834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.597198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.608708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:45.609188 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 289/591] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:45.609805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.615377 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 303/592] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:45.616468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.709623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60425e1-1f37-4ec9-9a0c-5e9220fb807f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.717337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20f4dc-e358-4c1f-85ef-51b2ded12954 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.743129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.743708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.743995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.744272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.745120 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:45.745434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.746888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.753746 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.754846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.755334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.755825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.763652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.768712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 290/593] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:45.768712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.769964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.784727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 28 16:19:45.786195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 304/594] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:45.787198 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.871259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866a669-72d0-4e50-95a8-9b65ca4d39f9 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.890971 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357441d-cf97-4d34-9934-8f3ef9a4da52 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:45.905434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.906097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.906387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.906718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.907525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:45.907839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.909267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.921515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 291/595] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:45.922423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:45.928460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:45.929515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:45.929999 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:45.930505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:45.942896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:45.944667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:45.962076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:45.968773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 305/596] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:45.969836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.021964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0da2d-6d32-4906-a2ec-74c33e6e42dd None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.057456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.058143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.058432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.058742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.059634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:46.059948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:46.061381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:46.083102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 292/597] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Apr 28 16:19:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:46.084073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.088987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8041a-dc9a-4d28-9c06-fc3a8bfb960a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.128364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c8689-02a3-40cc-83d0-5141d6e81ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.129627 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8689-02a3-40cc-83d0-5141d6e81ab7 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.130128 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8689-02a3-40cc-83d0-5141d6e81ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.130784 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c8689-02a3-40cc-83d0-5141d6e81ab7 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/9a5c2cf875f8451890e04b97b9686956/roles/b9f6881066644547b4a6bbe662963ab1` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.146748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c8689-02a3-40cc-83d0-5141d6e81ab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=9a5c2cf875f8451890e04b97b9686956, role_id=b9f6881066644547b4a6bbe662963ab1)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:46.148571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c8689-02a3-40cc-83d0-5141d6e81ab7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:46.191878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aececcb0-2758-467e-8ed6-7421b4457933 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.225121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.225711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.225996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.226276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.228968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:46.229943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:46.234834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 306/598] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:19:45 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/9a5c2cf875f8451890e04b97b9686956/roles/b9f6881066644547b4a6bbe662963ab1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:46.235437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c8689-02a3-40cc-83d0-5141d6e81ab7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.236410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:46.254178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 293/599] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:46.264257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.458234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c8689-02a3-40cc-83d0-5141d6e81ab7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.473164 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622b6cb-34cd-4805-ba60-1e3ad27166be None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.500151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.500870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.501160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.503178 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.514977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:46.516505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:46.523459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.524615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.525150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.525628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.535439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:46.536842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:46.537469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:46.538082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 307/600] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:46.543618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.558116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:46.560152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 294/601] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:46.565938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.650313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6423e-948f-4f39-8bc6-f2255b5b1b68 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.665528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9698-a3cc-48fc-a3fe-fd0cf08e09a0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.689311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a60c6-a679-4adb-922c-e2a627d525fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.690586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a60c6-a679-4adb-922c-e2a627d525fd None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.691048 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a60c6-a679-4adb-922c-e2a627d525fd None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.691478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a60c6-a679-4adb-922c-e2a627d525fd None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.692363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a60c6-a679-4adb-922c-e2a627d525fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:46.692830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a60c6-a679-4adb-922c-e2a627d525fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:46.694346 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a60c6-a679-4adb-922c-e2a627d525fd None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:46.701306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c30b-8249-4ce3-9076-2ab83f9fa451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.701970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c30b-8249-4ce3-9076-2ab83f9fa451 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.702624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c30b-8249-4ce3-9076-2ab83f9fa451 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.702624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c30b-8249-4ce3-9076-2ab83f9fa451 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.703356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c30b-8249-4ce3-9076-2ab83f9fa451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:46.703672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c30b-8249-4ce3-9076-2ab83f9fa451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:46.705176 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c30b-8249-4ce3-9076-2ab83f9fa451 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:46.708565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 308/602] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:46.710156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378a7a5-5ddf-4faa-9ab2-bdd31e42442c None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.710666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378a7a5-5ddf-4faa-9ab2-bdd31e42442c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.711149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378a7a5-5ddf-4faa-9ab2-bdd31e42442c None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.712901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 309/603] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:46.713773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378a7a5-5ddf-4faa-9ab2-bdd31e42442c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.721892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 295/604] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:46.723314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a157f-be7b-4bb2-9a08-1588c4c22dd7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.723668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a157f-be7b-4bb2-9a08-1588c4c22dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.723961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a157f-be7b-4bb2-9a08-1588c4c22dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.742661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-165a157f-be7b-4bb2-9a08-1588c4c22dd7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:46.744071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-165a157f-be7b-4bb2-9a08-1588c4c22dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:46.826625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 296/605] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:46.826625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a157f-be7b-4bb2-9a08-1588c4c22dd7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.854088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378a7a5-5ddf-4faa-9ab2-bdd31e42442c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.897223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.898292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.898876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.899310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:46.906368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:46.907983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:46.921337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:46.922769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 310/606] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:46.923683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:46.956524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a157f-be7b-4bb2-9a08-1588c4c22dd7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:46.989800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09722-1dd8-4ae7-a07e-b49ad77afa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:46.990723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09722-1dd8-4ae7-a07e-b49ad77afa95 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:46.991117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09722-1dd8-4ae7-a07e-b49ad77afa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:46.991289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd09722-1dd8-4ae7-a07e-b49ad77afa95 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/ebf1f55dbef94868aaac6d39ed70690b/roles/b9f6881066644547b4a6bbe662963ab1` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.006341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd09722-1dd8-4ae7-a07e-b49ad77afa95 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=ebf1f55dbef94868aaac6d39ed70690b, role_id=b9f6881066644547b4a6bbe662963ab1)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:47.007816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd09722-1dd8-4ae7-a07e-b49ad77afa95 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:47.026100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d319b-718c-4f4c-8efa-354f096e2e02 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:47.063801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86fe49-a903-493a-8714-d70ef24b5c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:47.064603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86fe49-a903-493a-8714-d70ef24b5c8d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:47.064886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86fe49-a903-493a-8714-d70ef24b5c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:47.065159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86fe49-a903-493a-8714-d70ef24b5c8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.075618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86fe49-a903-493a-8714-d70ef24b5c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:47.082678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-5a86fe49-a903-493a-8714-d70ef24b5c8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:47.088840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 311/607] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:47.088840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86fe49-a903-493a-8714-d70ef24b5c8d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:47.126900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 297/608] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:19:46 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/ebf1f55dbef94868aaac6d39ed70690b/roles/b9f6881066644547b4a6bbe662963ab1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:47.129120 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09722-1dd8-4ae7-a07e-b49ad77afa95 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:47.242172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86fe49-a903-493a-8714-d70ef24b5c8d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:47.286248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:47.288070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:47.289387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:47.289688 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.292246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:47.292587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:47.294121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:47.308613 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 312/609] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:47.314173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:47.361333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd09722-1dd8-4ae7-a07e-b49ad77afa95 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:47.396516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:47.397600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:47.398089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:47.398625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.399583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:47.400256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:47.401818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:47.411202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 298/610] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:47.416922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:47.419768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b02c5-1d9c-433a-8d20-8a2f7dab557d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:47.455513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1619086-e9c4-4f0a-94af-ab7bd535f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:47.455859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1619086-e9c4-4f0a-94af-ab7bd535f831 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:47.456031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1619086-e9c4-4f0a-94af-ab7bd535f831 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:47.456306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1619086-e9c4-4f0a-94af-ab7bd535f831 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/63f2a360a89548208edd5fdff1a04e35/roles/b9f6881066644547b4a6bbe662963ab1` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.472853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1619086-e9c4-4f0a-94af-ab7bd535f831 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=63f2a360a89548208edd5fdff1a04e35, role_id=b9f6881066644547b4a6bbe662963ab1)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:47.474339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1619086-e9c4-4f0a-94af-ab7bd535f831 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:47.531885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bcd89-9b55-420c-89c7-3230cbbab4a3 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:47.558428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 313/611] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:19:47 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/63f2a360a89548208edd5fdff1a04e35/roles/b9f6881066644547b4a6bbe662963ab1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:19:47.579534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b3861-1a64-44df-a100-6f98531b5580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:47.580354 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b3861-1a64-44df-a100-6f98531b5580 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:47.580640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b3861-1a64-44df-a100-6f98531b5580 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:47.580916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b3861-1a64-44df-a100-6f98531b5580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.597417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b3861-1a64-44df-a100-6f98531b5580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:47.599032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b3861-1a64-44df-a100-6f98531b5580 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:47.618778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-9f5b3861-1a64-44df-a100-6f98531b5580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:47.620339 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 299/612] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:47.626660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1619086-e9c4-4f0a-94af-ab7bd535f831 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:47.661035 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150d46-bec9-4324-954e-92115bff3e46 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:47.661330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150d46-bec9-4324-954e-92115bff3e46 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:47.661611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150d46-bec9-4324-954e-92115bff3e46 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.663220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 300/613] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:47.669562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3359-a125-4cfa-8d7e-d7b88a01fc9e None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:47.670902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3359-a125-4cfa-8d7e-d7b88a01fc9e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:47.671419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3359-a125-4cfa-8d7e-d7b88a01fc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.692590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-12bd3359-a125-4cfa-8d7e-d7b88a01fc9e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:47.694177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-12bd3359-a125-4cfa-8d7e-d7b88a01fc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:47.769833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1619086-e9c4-4f0a-94af-ab7bd535f831 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:47.820062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:47.821115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:47.821607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:47.822085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:47.823077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:47.823605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:47.825766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:47.827590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 301/614] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:47.845800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 314/615] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:47.850376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd3359-a125-4cfa-8d7e-d7b88a01fc9e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:47.859267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.004547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19177b93-eb80-407e-ab0a-2e91c6b709c6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.016423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd3359-a125-4cfa-8d7e-d7b88a01fc9e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.071205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.072018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.072307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.072588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.080217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:48.081654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:48.083815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa17e-68b7-473f-82df-5d37ad67d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.084638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa17e-68b7-473f-82df-5d37ad67d19f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.084928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa17e-68b7-473f-82df-5d37ad67d19f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.085208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fa17e-68b7-473f-82df-5d37ad67d19f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.095656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 16:19:48.097296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 302/616] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:48.102299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.108160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fa17e-68b7-473f-82df-5d37ad67d19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:48.115292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-e21fa17e-68b7-473f-82df-5d37ad67d19f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:48.116827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 315/617] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:48.123470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa17e-68b7-473f-82df-5d37ad67d19f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.210329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45cce-c5f6-4798-bba7-58dd0180e8ea None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.249037 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.249721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.250061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.257851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.257851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:48.257851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:48.257851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:48.272422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 303/618] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Apr 28 16:19:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:48.277257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.354754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fa17e-68b7-473f-82df-5d37ad67d19f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.416837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.417523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.417807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.418153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.420409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:48.420409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:48.421495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:48.434765 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 316/619] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:48.436067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.438871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f402415-d7d6-4131-8523-ff2738a2e529 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.503277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.504367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.504797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.505213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.522648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:48.524479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:48.548738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:48.550277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 304/620] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:48.555860 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.556883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6f8e0-a1de-4b5b-976c-8b761a35cfc4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.594121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.595193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.595641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.596060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.608029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:48.609743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:48.629116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:48.630867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 317/621] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:48.638018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.705509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49cf27-9e54-44c7-83a4-61facdf0b9fe None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.743999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.745080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.745560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.746031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.747096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:48.748153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:48.749736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:48.764025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 305/622] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:48.768813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.879859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5c4bb-c45d-4ebb-979f-8fbd59cbd5de None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.885285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fff577-c526-4faf-b856-6538c94ff20a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:48.920271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791659a-568a-47e7-9f52-eb8d0320bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.921449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791659a-568a-47e7-9f52-eb8d0320bada None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.921942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791659a-568a-47e7-9f52-eb8d0320bada None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.922422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791659a-568a-47e7-9f52-eb8d0320bada None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.929709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791659a-568a-47e7-9f52-eb8d0320bada None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:48.931411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791659a-568a-47e7-9f52-eb8d0320bada None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:48.940417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152c7bd-0401-44fd-bfc2-72a581acec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:48.941082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c7bd-0401-44fd-bfc2-72a581acec3b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.941372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c7bd-0401-44fd-bfc2-72a581acec3b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.941820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152c7bd-0401-44fd-bfc2-72a581acec3b None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.942648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152c7bd-0401-44fd-bfc2-72a581acec3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:48.942965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152c7bd-0401-44fd-bfc2-72a581acec3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:48.944401 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152c7bd-0401-44fd-bfc2-72a581acec3b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:48.947054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-4791659a-568a-47e7-9f52-eb8d0320bada None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:48.950596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 306/623] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:48.952079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2eddcb-e1ba-4f15-a5b3-5f4158fe0c27 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.952562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2eddcb-e1ba-4f15-a5b3-5f4158fe0c27 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.953030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2eddcb-e1ba-4f15-a5b3-5f4158fe0c27 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.954716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 307/624] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:48.959153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2eddcb-e1ba-4f15-a5b3-5f4158fe0c27 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:48.967004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 318/625] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:48.969344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d0854-71d7-44b7-bf95-4fb5e2ebc3b4 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:48.969646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d0854-71d7-44b7-bf95-4fb5e2ebc3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:48.969933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d0854-71d7-44b7-bf95-4fb5e2ebc3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:48.990339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-9e0d0854-71d7-44b7-bf95-4fb5e2ebc3b4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:48.992267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-9e0d0854-71d7-44b7-bf95-4fb5e2ebc3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:49.074832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 319/626] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:49.077267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d0854-71d7-44b7-bf95-4fb5e2ebc3b4 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:49.087160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2eddcb-e1ba-4f15-a5b3-5f4158fe0c27 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:49.135904 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:49.136575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:49.136869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:49.137153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:49.138904 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:49.139223 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:49.141204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:49.158931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 308/627] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:49.162941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:49.195296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d0854-71d7-44b7-bf95-4fb5e2ebc3b4 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:49.251010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:49.252751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:49.253552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:49.254035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:49.263889 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:49.266821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:49.288752 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:19:49.290560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0fa58-4aef-46e0-a841-7d3eadc12c4f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:49.290776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 320/628] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:19:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:49.291757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:49.337629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2697a93-59a1-4c6e-90cf-32888264d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:49.338736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697a93-59a1-4c6e-90cf-32888264d3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:49.339151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697a93-59a1-4c6e-90cf-32888264d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:49.339429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2697a93-59a1-4c6e-90cf-32888264d3b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:49.352373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2697a93-59a1-4c6e-90cf-32888264d3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:49.360508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-e2697a93-59a1-4c6e-90cf-32888264d3b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:49.362154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 309/629] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:49.363243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2697a93-59a1-4c6e-90cf-32888264d3b4 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:49.430470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cfae3-53a4-4b16-a3bd-38284e009ff3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:49.470136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2697a93-59a1-4c6e-90cf-32888264d3b4 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:49.474842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6fda6-7133-4acc-b142-4924bffd2419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:49.475934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fda6-7133-4acc-b142-4924bffd2419 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:49.476359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fda6-7133-4acc-b142-4924bffd2419 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:49.476790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fda6-7133-4acc-b142-4924bffd2419 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/6f397f35533540c6b92f0f4fe220d565/roles/b9f6881066644547b4a6bbe662963ab1` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:49.499841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6fda6-7133-4acc-b142-4924bffd2419 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=6f397f35533540c6b92f0f4fe220d565, role_id=b9f6881066644547b4a6bbe662963ab1)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:49.502571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6fda6-7133-4acc-b142-4924bffd2419 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:49.507166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:49.507930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:49.508317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:49.508666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:49.509706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:49.510098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:49.511693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:49.529496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 310/630] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:19:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:49.533385 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:49.577607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 321/631] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:19:49 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/6f397f35533540c6b92f0f4fe220d565/roles/b9f6881066644547b4a6bbe662963ab1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:19:49.579047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6fda6-7133-4acc-b142-4924bffd2419 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:49.637326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc07b-910c-40cd-b0b9-ae833ef2455d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:49.675085 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:49.675804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:49.676045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:49.676393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:49.677079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:49.677386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:49.679196 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:49.689377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 311/632] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:49.698065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:49.718411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6fda6-7133-4acc-b142-4924bffd2419 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:49.758777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e630e-c085-44d1-9443-cd3fd386bc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:49.759720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e630e-c085-44d1-9443-cd3fd386bc6a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:49.760604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e630e-c085-44d1-9443-cd3fd386bc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:49.761082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e630e-c085-44d1-9443-cd3fd386bc6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:49.844509 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e630e-c085-44d1-9443-cd3fd386bc6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:49.846018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e630e-c085-44d1-9443-cd3fd386bc6a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:49.882682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac0cc-2778-4324-aa55-3385dcc57d2e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:49.921104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:49.922286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:49.923055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:49.923541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:49.936281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:49.938022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:49.956924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:49.958883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 312/633] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:49.964182 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.069725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 322/634] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:50.075798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87ea1-96da-45e8-b0e4-535470266f04 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.076097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87ea1-96da-45e8-b0e4-535470266f04 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.076380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87ea1-96da-45e8-b0e4-535470266f04 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.077980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 323/635] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:50.079260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87ea1-96da-45e8-b0e4-535470266f04 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.093025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a28c4-20df-49ac-8518-576ae34f0d61 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.137719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2a50a-1f04-4c98-b2dc-75673814a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.138857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a50a-1f04-4c98-b2dc-75673814a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.139491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a50a-1f04-4c98-b2dc-75673814a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.139953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a50a-1f04-4c98-b2dc-75673814a6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.141430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2a50a-1f04-4c98-b2dc-75673814a6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:50.141944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2a50a-1f04-4c98-b2dc-75673814a6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:50.144351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2a50a-1f04-4c98-b2dc-75673814a6f5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:50.160045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 313/636] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:50.161575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b58ad-31af-48d6-9b94-7a0baff2f1f7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.162034 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b58ad-31af-48d6-9b94-7a0baff2f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.162476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b58ad-31af-48d6-9b94-7a0baff2f1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.180762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1f1b58ad-31af-48d6-9b94-7a0baff2f1f7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:50.182055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1f1b58ad-31af-48d6-9b94-7a0baff2f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:50.194758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87ea1-96da-45e8-b0e4-535470266f04 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.234274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd482dc7-8549-40f5-a13a-86b0d01b79de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.235027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482dc7-8549-40f5-a13a-86b0d01b79de None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.235315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482dc7-8549-40f5-a13a-86b0d01b79de None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.235594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd482dc7-8549-40f5-a13a-86b0d01b79de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.245466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd482dc7-8549-40f5-a13a-86b0d01b79de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:50.247559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd482dc7-8549-40f5-a13a-86b0d01b79de None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:50.250149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 314/637] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:50.251022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b58ad-31af-48d6-9b94-7a0baff2f1f7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.274236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-bd482dc7-8549-40f5-a13a-86b0d01b79de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:50.276536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 324/638] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:50.278634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c1ffb-17cb-4fc6-9128-a054e1c3a537 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.279258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c1ffb-17cb-4fc6-9128-a054e1c3a537 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.280056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c1ffb-17cb-4fc6-9128-a054e1c3a537 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.281790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 325/639] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:50.282973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c1ffb-17cb-4fc6-9128-a054e1c3a537 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.346700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b58ad-31af-48d6-9b94-7a0baff2f1f7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.379242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.380037 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.380318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.380591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.387488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:50.388985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:50.389649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c1ffb-17cb-4fc6-9128-a054e1c3a537 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.403284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 28 16:19:50.408896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 315/640] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:50.408896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.424194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b82d05-6703-43c2-89a8-6c526e111489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.424996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b82d05-6703-43c2-89a8-6c526e111489 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.425286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b82d05-6703-43c2-89a8-6c526e111489 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.425573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b82d05-6703-43c2-89a8-6c526e111489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.436571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b82d05-6703-43c2-89a8-6c526e111489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:50.443670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-d0b82d05-6703-43c2-89a8-6c526e111489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:50.449532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 326/641] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:50.449532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a88d-aa45-4322-b951-0abc5f45e24c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.449532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a88d-aa45-4322-b951-0abc5f45e24c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.449532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62a88d-aa45-4322-b951-0abc5f45e24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.462434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-3e62a88d-aa45-4322-b951-0abc5f45e24c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:50.463739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3e62a88d-aa45-4322-b951-0abc5f45e24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:50.507124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cae100-de98-4d4c-8df9-c551faa8e6b8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.528805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 327/642] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:50.529719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62a88d-aa45-4322-b951-0abc5f45e24c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.552337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.553745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.554122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.554402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.555190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:50.555496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:50.556860 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:50.568564 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 316/643] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:50.569393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.631328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62a88d-aa45-4322-b951-0abc5f45e24c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.664313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05bc8f-97cc-4e04-b3a0-94864a7f2449 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.665245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.665926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.666216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.666503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.667385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:50.667698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:50.669696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:50.686402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 328/644] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:50.687484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.703300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.704338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.705110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.705561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.706462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:50.706940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:50.709185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:50.717657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 317/645] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:50.717657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.785432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d5c30-450f-4834-a2c3-d4be8dc37fec None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.812730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7589f5d-833c-4e1a-9d49-a7d258475b26 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.819096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c555c-a533-4872-9592-cc26d78a2758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.820301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c555c-a533-4872-9592-cc26d78a2758 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.820582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c555c-a533-4872-9592-cc26d78a2758 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.820855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c555c-a533-4872-9592-cc26d78a2758 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.831227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c555c-a533-4872-9592-cc26d78a2758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:50.838207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-fa9c555c-a533-4872-9592-cc26d78a2758 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:50.844547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 329/646] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:50.844547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c555c-a533-4872-9592-cc26d78a2758 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.851414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.852218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.852507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.852788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:50.859989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:50.861564 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:50.877141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:50.878404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 318/647] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:50.879216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:50.941330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c555c-a533-4872-9592-cc26d78a2758 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.981380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369eaaa8-d858-4ff0-82ff-fc00c72f0f8d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:50.982053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ce7c1-be05-4e52-b5dd-522c63bbc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:50.982900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ce7c1-be05-4e52-b5dd-522c63bbc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:50.983238 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ce7c1-be05-4e52-b5dd-522c63bbc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:50.984227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ce7c1-be05-4e52-b5dd-522c63bbc4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.013958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.014985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.015276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.015562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.025257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.026743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.049131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:51.055209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 319/648] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:51.055209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.062421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ce7c1-be05-4e52-b5dd-522c63bbc4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.063972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ce7c1-be05-4e52-b5dd-522c63bbc4c7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.148672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7b1a8-095e-45dd-a742-9058757328a8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.158798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 330/649] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:51.159712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ce7c1-be05-4e52-b5dd-522c63bbc4c7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.187889 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.188558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.188839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.189241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.189878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:51.190147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.191544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.204327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 320/650] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:51.204327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.264222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ce7c1-be05-4e52-b5dd-522c63bbc4c7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.298237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.298850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.299134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.299414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.300194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:51.300510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.301997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.304516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea153-5cc2-4acf-905e-f96d062c56fd None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.318813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 331/651] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:51.318813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.342106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.343037 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.343512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.344107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.345352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:51.345969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.348298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.361493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 321/652] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:51.362627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.415510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec32718-4be5-4309-ab82-9b7caad4885d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.448963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.449760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.450620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.450903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.461156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.462777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.464478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46016b06-8e42-4c8c-ba44-5f83f3ff0ea4 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.478789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:51.480071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 332/653] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:51.480842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.502297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.503401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.503913 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.504200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.514609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.516055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.533632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:51.539619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 322/654] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:51.539619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.585091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083ca07-3248-448c-a56b-4861dcde1bf2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.620129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.620794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.621084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.621364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.622801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=5b28dcc32b984429939b95e436b4d41e) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:51.623121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.624569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.638638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 333/655] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/role_assignments?user.id=5b28dcc32b984429939b95e436b4d41e&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:51.638638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.641914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a6b13-fc2a-4de3-beb5-b5bdae0ebe57 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.688506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.689330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.689614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.689889 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.698981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.701298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.720281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 28 16:19:51.727035 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 323/656] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:51.728015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.740374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10788c-866d-4981-89bc-7ddd4809561e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.775984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.776805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.777163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.777513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.778407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:51.778816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.780301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.793318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 334/657] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:51.794953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.853386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982cc3-13b3-4539-bad8-f6676765139c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.891611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.892288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.892576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.892856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.893595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:51.893907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.895328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:51.910847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 324/658] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:51.910847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:51.933830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa3ff5-cc3b-4737-bb4d-bc1129a55738 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:51.979638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:51.980684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:51.981915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:51.982389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:51.983518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:51.984058 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:51.985691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.003822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 335/659] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:52.004978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.026864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fda3-7e6f-4eb6-954d-fc482c88025b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.063208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18c095-b140-44c6-9a25-f6457a6a1b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.064022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c095-b140-44c6-9a25-f6457a6a1b7a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.064310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c095-b140-44c6-9a25-f6457a6a1b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.064590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18c095-b140-44c6-9a25-f6457a6a1b7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.071244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18c095-b140-44c6-9a25-f6457a6a1b7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:52.072737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18c095-b140-44c6-9a25-f6457a6a1b7a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.086159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-7f18c095-b140-44c6-9a25-f6457a6a1b7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:52.087409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 325/660] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:52.088688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795040d-ebee-4221-be44-f18099c23eae None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.088981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795040d-ebee-4221-be44-f18099c23eae None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.089264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795040d-ebee-4221-be44-f18099c23eae None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.094686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 326/661] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:52.094686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795040d-ebee-4221-be44-f18099c23eae None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.123232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444f2cf-5862-4315-9fba-1e1bc424c90f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.156402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.157201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.157483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.157758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.164865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:52.166341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.180715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 28 16:19:52.181997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 336/662] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:52.182791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.200963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795040d-ebee-4221-be44-f18099c23eae None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.234105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13bad0-5b63-4b8e-b858-5f71f8830ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.234776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13bad0-5b63-4b8e-b858-5f71f8830ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.235062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13bad0-5b63-4b8e-b858-5f71f8830ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.235337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13bad0-5b63-4b8e-b858-5f71f8830ad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.283217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86f93-a6bb-400a-9344-c40192c15b45 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.301036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13bad0-5b63-4b8e-b858-5f71f8830ad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:52.302472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13bad0-5b63-4b8e-b858-5f71f8830ad6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.316826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd244e36-ce72-468b-a3ed-fb61fa696c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.317487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244e36-ce72-468b-a3ed-fb61fa696c7d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.317766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244e36-ce72-468b-a3ed-fb61fa696c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.318048 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244e36-ce72-468b-a3ed-fb61fa696c7d None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.318869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd244e36-ce72-468b-a3ed-fb61fa696c7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:52.319185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd244e36-ce72-468b-a3ed-fb61fa696c7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:52.320602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd244e36-ce72-468b-a3ed-fb61fa696c7d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.332330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 337/663] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:52.333689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451dd9-cb0b-4a7b-9b93-831da713974f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.334064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451dd9-cb0b-4a7b-9b93-831da713974f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.334406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac451dd9-cb0b-4a7b-9b93-831da713974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.351141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ac451dd9-cb0b-4a7b-9b93-831da713974f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:52.352413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ac451dd9-cb0b-4a7b-9b93-831da713974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:52.406894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 327/664] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:52.406894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13bad0-5b63-4b8e-b858-5f71f8830ad6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.417085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 338/665] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:52.417930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac451dd9-cb0b-4a7b-9b93-831da713974f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.500195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13bad0-5b63-4b8e-b858-5f71f8830ad6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.516886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac451dd9-cb0b-4a7b-9b93-831da713974f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.534063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.534756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.535041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.535318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.536150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:52.536459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:52.537867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.552959 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.553619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.553905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.554182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.555129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=9a5c2cf875f8451890e04b97b9686956) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:52.555974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:52.556900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.562977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 328/666] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:52.562977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.568152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 339/667] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/role_assignments?user.id=9a5c2cf875f8451890e04b97b9686956&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:52.579616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.687487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de1023-8245-4363-941d-d3b6efb96270 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.719649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a363a5-5643-4327-ac71-6d643f913d22 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.726926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.727981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.728374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.728758 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.740652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:52.742470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.760818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:52.762068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 329/668] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:52.763790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cb2cf-91ef-4092-b069-c207045de1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.764206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.765134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cb2cf-91ef-4092-b069-c207045de1dd None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.765565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cb2cf-91ef-4092-b069-c207045de1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.765982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cb2cf-91ef-4092-b069-c207045de1dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.780184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cb2cf-91ef-4092-b069-c207045de1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:52.787784 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-c62cb2cf-91ef-4092-b069-c207045de1dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:19:52.789530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 340/669] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:52.790552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cb2cf-91ef-4092-b069-c207045de1dd None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:52.895184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd616-ec9f-4a53-8ca2-184f52afeb0b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.936471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cb2cf-91ef-4092-b069-c207045de1dd None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:52.947403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4725798-61b0-4876-a411-cb1bb20b3285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.948000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4725798-61b0-4876-a411-cb1bb20b3285 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.948284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4725798-61b0-4876-a411-cb1bb20b3285 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.948560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4725798-61b0-4876-a411-cb1bb20b3285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.976038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:52.976704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:52.976989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:52.977266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:52.977994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:52.978302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:52.979794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:52.991910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 341/670] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:52.992826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.037425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4725798-61b0-4876-a411-cb1bb20b3285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.041830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4725798-61b0-4876-a411-cb1bb20b3285 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.116817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf46434-49b7-44ca-93fc-3aaeaeb1e60e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.150829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 330/671] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:19:53.151893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4725798-61b0-4876-a411-cb1bb20b3285 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.156669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.157558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.158156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.158657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.159596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:53.160105 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.161679 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.175568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 342/672] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:19:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:53.181517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.255506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4725798-61b0-4876-a411-cb1bb20b3285 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.294903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf202f-6f8f-4e66-af11-0466f1da365b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.296310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.297311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.297613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.298839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.308032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.310190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.328426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:53.330318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 331/673] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:53.331586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.332270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945df471-0758-4136-af74-15e090f391e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.333282 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df471-0758-4136-af74-15e090f391e6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.333823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df471-0758-4136-af74-15e090f391e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.334593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df471-0758-4136-af74-15e090f391e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.346000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945df471-0758-4136-af74-15e090f391e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.347912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945df471-0758-4136-af74-15e090f391e6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.369699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-945df471-0758-4136-af74-15e090f391e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:53.371544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 343/674] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:53.375274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945df471-0758-4136-af74-15e090f391e6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.446499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b029a5-5de2-4869-80ca-697b0796c750 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.484433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.486010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.486741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.487466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.500685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945df471-0758-4136-af74-15e090f391e6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.504294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.506112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.526292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:53.528784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 332/675] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:53.529783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.544556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.545149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.545431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.545709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.546516 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:53.546856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.548415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.561393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 344/676] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:53.562314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.636643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da89d96-2a85-4d9a-a134-1a0d693b63b8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.660915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487f759-ea0c-461c-9f5d-5bc24baefcda None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.671644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.672600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.673082 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.673566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.674569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:53.675073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.676742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.689542 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 333/677] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:53.690744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.701220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.701895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.702181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.702459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.703487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:53.703608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.704919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.717527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 345/678] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:53.718508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.797949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80d1d7-9b3c-423d-86c6-b3c9db454352 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.825870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c3d21-efb6-4eb7-8a5a-be7af61e24a9 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:53.838496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.839907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.841155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.841860 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.843051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=ebf1f55dbef94868aaac6d39ed70690b) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:53.843566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.845672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.853097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 334/679] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/role_assignments?user.id=ebf1f55dbef94868aaac6d39ed70690b&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:53.854191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.861179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:53.862017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:53.862304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:53.862605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:53.870052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:53.871881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:53.886227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:53.892931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 346/680] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:53.894295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:53.966699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d66d4c-0d34-493c-a91e-91370060fed8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.000998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eefad-b631-4d62-b200-70ed85c54d9b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.002796 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.003823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.004304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.004798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.013885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:54.015715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:54.031126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 16:19:54.033025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 335/681] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:54.039609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.039609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.039609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.039609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.040313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:54.040625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:54.041945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.052882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:54.073189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 347/682] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:54.079977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.178447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117753cc-929b-42eb-96a6-edb03b3f45bf None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.207685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782be57f-e22e-47f3-93e6-2f53afdd4831 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.218405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c07e7-8db0-46eb-9627-d54e5ca288f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.219200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c07e7-8db0-46eb-9627-d54e5ca288f5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.219489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c07e7-8db0-46eb-9627-d54e5ca288f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.219769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c07e7-8db0-46eb-9627-d54e5ca288f5 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.220931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c07e7-8db0-46eb-9627-d54e5ca288f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:54.221242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c07e7-8db0-46eb-9627-d54e5ca288f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:54.223009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c07e7-8db0-46eb-9627-d54e5ca288f5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:54.249408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 336/683] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:54.249408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e4a2-7c60-425a-9875-f3a45c6a5137 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.249408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e4a2-7c60-425a-9875-f3a45c6a5137 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.249408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0e4a2-7c60-425a-9875-f3a45c6a5137 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.258801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 337/684] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:54.258869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451feab6-b9ef-4bd0-a36e-b650f56c019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.259028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0e4a2-7c60-425a-9875-f3a45c6a5137 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.259100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451feab6-b9ef-4bd0-a36e-b650f56c019b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.259100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451feab6-b9ef-4bd0-a36e-b650f56c019b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.259100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451feab6-b9ef-4bd0-a36e-b650f56c019b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.259100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451feab6-b9ef-4bd0-a36e-b650f56c019b None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=63f2a360a89548208edd5fdff1a04e35) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:54.259100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451feab6-b9ef-4bd0-a36e-b650f56c019b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:54.259100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451feab6-b9ef-4bd0-a36e-b650f56c019b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:54.269865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 348/685] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/role_assignments?user.id=63f2a360a89548208edd5fdff1a04e35&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:54.271883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf13ba-eccc-4938-b4c8-f478d29773c8 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.272425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf13ba-eccc-4938-b4c8-f478d29773c8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.273291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf13ba-eccc-4938-b4c8-f478d29773c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.296115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d1cf13ba-eccc-4938-b4c8-f478d29773c8 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:54.297825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d1cf13ba-eccc-4938-b4c8-f478d29773c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:54.364123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0e4a2-7c60-425a-9875-f3a45c6a5137 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.389064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 349/686] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:54.404000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2223-c189-4822-af20-2b698ac8db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.405095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2223-c189-4822-af20-2b698ac8db08 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.405574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2223-c189-4822-af20-2b698ac8db08 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.406070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db2223-c189-4822-af20-2b698ac8db08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.412469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf13ba-eccc-4938-b4c8-f478d29773c8 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.479146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db2223-c189-4822-af20-2b698ac8db08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:54.481005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db2223-c189-4822-af20-2b698ac8db08 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:54.516606 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf13ba-eccc-4938-b4c8-f478d29773c8 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.551764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b7b3a-f418-47fe-ae6e-7b83220f25da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.553396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b7b3a-f418-47fe-ae6e-7b83220f25da None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.553396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b7b3a-f418-47fe-ae6e-7b83220f25da None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.553396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b7b3a-f418-47fe-ae6e-7b83220f25da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.565006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b7b3a-f418-47fe-ae6e-7b83220f25da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:54.572405 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-e55b7b3a-f418-47fe-ae6e-7b83220f25da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:19:54.573978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 350/687] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:54.580453 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b7b3a-f418-47fe-ae6e-7b83220f25da None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.587396 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 338/688] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 16:19:54.593127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2223-c189-4822-af20-2b698ac8db08 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.682791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b7b3a-f418-47fe-ae6e-7b83220f25da None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.710877 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db2223-c189-4822-af20-2b698ac8db08 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.719860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.720886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.721170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.721756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.722828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:54.723141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:54.725044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:54.736087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 351/689] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:54.741268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.748947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.749767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.750054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.750334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.761885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:54.763465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:54.782278 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:54.783983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 339/690] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:54.790004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.897625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dc17b-2a73-4fa0-ad86-51579edb7712 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:54.935816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:54.936415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:54.936704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:54.936983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:54.937719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:54.938026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:54.939427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:54.951335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 340/691] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:54.957739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:54.976063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afb84-9b51-42d2-9c0f-77e360450ae5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.015456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.016577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.016961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.018122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.031631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.033528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.057404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:55.058947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 352/692] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:55.067716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.085386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad734-aa35-4377-b6a9-1527926d506e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.140598 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf9793-e656-40bc-8761-0c6b5c13caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.141414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9793-e656-40bc-8761-0c6b5c13caef None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.141699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9793-e656-40bc-8761-0c6b5c13caef None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.141976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9793-e656-40bc-8761-0c6b5c13caef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.148965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf9793-e656-40bc-8761-0c6b5c13caef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.150425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf9793-e656-40bc-8761-0c6b5c13caef None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.164725 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-bfcf9793-e656-40bc-8761-0c6b5c13caef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:55.166238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 341/693] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:55.167560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78540b9c-481a-466f-ba7b-8f8d0999db56 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.167846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78540b9c-481a-466f-ba7b-8f8d0999db56 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.168125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78540b9c-481a-466f-ba7b-8f8d0999db56 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.170567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 342/694] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:55.175774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43b7f1-175c-4298-9c5a-e369e4a9f775 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.176065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43b7f1-175c-4298-9c5a-e369e4a9f775 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.176344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43b7f1-175c-4298-9c5a-e369e4a9f775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.181954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec8876-8cfa-44f3-a214-00f517c91c4a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.193965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1c43b7f1-175c-4298-9c5a-e369e4a9f775 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:55.195128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1c43b7f1-175c-4298-9c5a-e369e4a9f775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:55.226342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.227194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.227491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.228086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.229164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:55.229478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.230935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.249927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 353/695] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:55.250833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.274629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 343/696] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:55.275713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43b7f1-175c-4298-9c5a-e369e4a9f775 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.372194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a84f5-75cb-4f31-b034-afe30bcc5386 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.387958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43b7f1-175c-4298-9c5a-e369e4a9f775 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.409567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.410244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.410528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.410830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.411624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:55.411932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.413369 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.423465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.424287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.424572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.424851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.425447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 354/697] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:55.426382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.432683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.434340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.448241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:19:55.449717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 344/698] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:55.451148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.525244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816514c-ae40-47ea-93a1-c56a7e2df3ca None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.547579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830be675-69d4-4ff2-b107-60a0563eef64 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.558959 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.559814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.560098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.560379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.561042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.562417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.576079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 28 16:19:55.577669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 355/699] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:55.578456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.586935 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.587682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.588038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.588393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.589812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=6f397f35533540c6b92f0f4fe220d565) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:55.591046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.593879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.601577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 345/700] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/role_assignments?user.id=6f397f35533540c6b92f0f4fe220d565&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:55.602474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.683852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee3f4-1fd7-436c-8653-cf9d149bec4f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.707035 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b9ed-0414-40a2-9d55-d4af44f99b97 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.743349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.744066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.744352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.744631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.745361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:55.745673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.747669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.752251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.752954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.753131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 346/701] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:55.753324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.753668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.754698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:55.755018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.756515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.758661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.795447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 356/702] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:55.801095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:55.863369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5829c06-05b0-4ceb-be35-65a6192e80f9 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.899062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.899996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.900284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.900565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:55.901297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:55.901740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:55.903492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:55.910832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 347/703] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:55.921454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae72a91-75ac-40d0-98b0-d0c0bc07b62f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:55.959480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731a3a8-1658-4994-8520-1dd9431b5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:55.960496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a3a8-1658-4994-8520-1dd9431b5d08 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:55.960976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a3a8-1658-4994-8520-1dd9431b5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:55.961445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731a3a8-1658-4994-8520-1dd9431b5d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:56.037968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731a3a8-1658-4994-8520-1dd9431b5d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:56.039883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731a3a8-1658-4994-8520-1dd9431b5d08 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:56.159437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 357/704] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 28 16:19:56.165984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:56.267153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e627b-e022-4e63-8ace-986acf5a4491 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:56.300893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:56.301699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:56.301985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:56.302264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:56.313813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:56.315294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:56.331652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:56.333175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 348/705] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:56.339629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731a3a8-1658-4994-8520-1dd9431b5d08 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:56.472266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731a3a8-1658-4994-8520-1dd9431b5d08 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:56.511957 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:56.512991 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:56.513474 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:56.513948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:56.514917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:56.515446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:56.517008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:56.533619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 358/706] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:56.539072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:56.676044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49e590-4587-4d14-a8ca-00d6d8a61be3 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:56.718627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b95bd-1960-45c0-be14-e78d200dbdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:56.719500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b95bd-1960-45c0-be14-e78d200dbdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:56.719790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b95bd-1960-45c0-be14-e78d200dbdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:56.720066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b95bd-1960-45c0-be14-e78d200dbdd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:56.727191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b95bd-1960-45c0-be14-e78d200dbdd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:56.728642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b95bd-1960-45c0-be14-e78d200dbdd5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:56.748380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-d24b95bd-1960-45c0-be14-e78d200dbdd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:19:56.749928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 349/707] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:56.755255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:56.780748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911534-9bd5-4b35-99db-46bc0c402df5 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:56.781059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911534-9bd5-4b35-99db-46bc0c402df5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:56.781331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911534-9bd5-4b35-99db-46bc0c402df5 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:56.782761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 350/708] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:56.787403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d181-8138-499e-97fd-c1f285442d50 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:56.787638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d181-8138-499e-97fd-c1f285442d50 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:56.787925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d181-8138-499e-97fd-c1f285442d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:56.810210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-cca2d181-8138-499e-97fd-c1f285442d50 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:56.811657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-cca2d181-8138-499e-97fd-c1f285442d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:56.890490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 351/709] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:56.928486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d181-8138-499e-97fd-c1f285442d50 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:56.950701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4c19f-31d8-4873-835d-38eb9359e237 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:57.014101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:57.014803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:57.015085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:57.015356 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:57.016153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:57.016459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:57.017881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:57.040492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 359/710] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:57.046844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:57.075295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d181-8138-499e-97fd-c1f285442d50 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:57.134654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:57.135464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:57.135743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:57.136687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:57.136779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:57.138679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:57.159226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 28 16:19:57.159976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 352/711] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:19:56 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:57.169423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:57.238736 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd8b28-60c6-45fc-ad72-745357fc908f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:57.294587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727b92-0372-4baa-9af5-1030f05725b9 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:57.312182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:57.312969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:57.313254 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:57.313534 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:57.314450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=5b28dcc32b984429939b95e436b4d41e) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:57.314817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:57.316257 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:57.329661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 360/712] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:19:57 2022] GET /identity/v3/role_assignments?user.id=5b28dcc32b984429939b95e436b4d41e&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:57.331944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8882e76-dd00-4852-afd3-7bec67f9373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:57.332621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8882e76-dd00-4852-afd3-7bec67f9373f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:57.332908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8882e76-dd00-4852-afd3-7bec67f9373f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:57.333189 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8882e76-dd00-4852-afd3-7bec67f9373f None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:57.333913 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8882e76-dd00-4852-afd3-7bec67f9373f None admin] RBAC: Adding query filter params (name=network) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:57.334224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8882e76-dd00-4852-afd3-7bec67f9373f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:57.335723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8882e76-dd00-4852-afd3-7bec67f9373f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:57.345516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 353/713] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:19:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:57.347017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:57.454566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf9074-5511-4d60-ba65-2b570ca252fa None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:57.481017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb95f90-b366-4d71-83bc-8347cc4c624d None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:57.481348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb95f90-b366-4d71-83bc-8347cc4c624d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:57.481584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb95f90-b366-4d71-83bc-8347cc4c624d None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:57.484138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 354/714] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:57.488662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1519-e012-40e6-804e-a99a32f68300 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:57.489251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1519-e012-40e6-804e-a99a32f68300 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:57.489572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:57.489985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d1519-e012-40e6-804e-a99a32f68300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:57.490251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:57.490747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:57.490934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:57.491560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:57.491868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:57.493415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:57.501391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 361/715] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:19:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:57.539915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-da6d1519-e012-40e6-804e-a99a32f68300 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:57.541505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-da6d1519-e012-40e6-804e-a99a32f68300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:57.640517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 355/716] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:57.665351 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:57.770990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64eccf-c13b-434e-8a50-da40da9e8ac1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:57.805578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:57.806860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:57.807352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:57.807809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:57.819377 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:57.821105 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:57.838124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:57.839971 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 362/717] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:57.845926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1519-e012-40e6-804e-a99a32f68300 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:58.090254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d1519-e012-40e6-804e-a99a32f68300 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:58.140606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28098e33-0917-4451-b8b7-65afe1da7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:58.141294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098e33-0917-4451-b8b7-65afe1da7b6c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:58.141582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098e33-0917-4451-b8b7-65afe1da7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:58.141859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28098e33-0917-4451-b8b7-65afe1da7b6c None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:58.142613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28098e33-0917-4451-b8b7-65afe1da7b6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:58.142924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28098e33-0917-4451-b8b7-65afe1da7b6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:58.144285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28098e33-0917-4451-b8b7-65afe1da7b6c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:58.160499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 356/718] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:58.165999 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:58.287313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c168-45a4-43ee-b468-74b6ae46576b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:58.322602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db00a0-bd35-445d-a70d-df36f38c261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:58.323296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db00a0-bd35-445d-a70d-df36f38c261f None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:58.323584 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db00a0-bd35-445d-a70d-df36f38c261f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:58.323867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db00a0-bd35-445d-a70d-df36f38c261f None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:58.324604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db00a0-bd35-445d-a70d-df36f38c261f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:58.326582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db00a0-bd35-445d-a70d-df36f38c261f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:58.442173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 363/719] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:19:58 2022] POST /identity/v3/users => generated 254 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:58.609732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db95d-21d8-44c3-8e8c-27eae007b90b None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:58.610859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db95d-21d8-44c3-8e8c-27eae007b90b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:58.611424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8db95d-21d8-44c3-8e8c-27eae007b90b None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:58.613419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 357/720] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:19:58.619417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb16ff-019b-4ffb-9124-d44e43c6351d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:58.619994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb16ff-019b-4ffb-9124-d44e43c6351d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:58.620496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb16ff-019b-4ffb-9124-d44e43c6351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:58.639050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4ecb16ff-019b-4ffb-9124-d44e43c6351d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:58.640592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4ecb16ff-019b-4ffb-9124-d44e43c6351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:58.714779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 364/721] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:19:58.736102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8db95d-21d8-44c3-8e8c-27eae007b90b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:58.849301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8db95d-21d8-44c3-8e8c-27eae007b90b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:58.883333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fbd06-3d1f-4090-bc45-3cb6a2b773f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:58.884063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fbd06-3d1f-4090-bc45-3cb6a2b773f4 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:58.884345 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fbd06-3d1f-4090-bc45-3cb6a2b773f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:58.884626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fbd06-3d1f-4090-bc45-3cb6a2b773f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:58.895798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fbd06-3d1f-4090-bc45-3cb6a2b773f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:19:58.902703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-1f4fbd06-3d1f-4090-bc45-3cb6a2b773f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:19:58.904215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 358/722] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:58.910157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb16ff-019b-4ffb-9124-d44e43c6351d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:58.922560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7769-0caf-4195-b3dc-6aa9617b79f8 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:58.922864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7769-0caf-4195-b3dc-6aa9617b79f8 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:58.923131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7769-0caf-4195-b3dc-6aa9617b79f8 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:58.924470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 359/723] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:19:58.929662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94077948-3030-4cc1-9681-7433fec4ccfa None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:58.929952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94077948-3030-4cc1-9681-7433fec4ccfa None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:58.930233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94077948-3030-4cc1-9681-7433fec4ccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:58.952017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-94077948-3030-4cc1-9681-7433fec4ccfa None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:19:58.954067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-94077948-3030-4cc1-9681-7433fec4ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:19:59.037291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb16ff-019b-4ffb-9124-d44e43c6351d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:59.057306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 360/724] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:19:59.083630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94077948-3030-4cc1-9681-7433fec4ccfa None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:59.100135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:59.100821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:59.101110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:59.101389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:59.102154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:59.102466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:59.103875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:59.122510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 365/725] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:59.127664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:59.194753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94077948-3030-4cc1-9681-7433fec4ccfa None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:59.264389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcecb2-3c4d-42f9-bf19-2cd45f2b7e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:59.265065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcecb2-3c4d-42f9-bf19-2cd45f2b7e49 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:59.265355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcecb2-3c4d-42f9-bf19-2cd45f2b7e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:59.265633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcecb2-3c4d-42f9-bf19-2cd45f2b7e49 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:59.266373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcecb2-3c4d-42f9-bf19-2cd45f2b7e49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:59.267770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcecb2-3c4d-42f9-bf19-2cd45f2b7e49 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:59.290908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881398-5948-4bf5-b068-50753e2602f2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:59.330109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:59.331188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:59.331550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:59.331918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:59.351537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:59.353326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:59.371055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:19:59.372924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 366/726] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:19:59.378610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:59.412402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 361/727] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:19:59 2022] POST /identity/v3/services => generated 251 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:19:59.500069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa622931-8fa6-420e-96f2-0e2f9e3102eb None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:59.556982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:59.557667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:59.557953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:59.558233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:59.559004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:59.559860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:59.561246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:59.578906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 367/728] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:19:59.584409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcecb2-3c4d-42f9-bf19-2cd45f2b7e49 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:59.705610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcecb2-3c4d-42f9-bf19-2cd45f2b7e49 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:59.738851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:59.739651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:59.739931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:59.740201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:59.749372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:59.750885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:59.767324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 16:19:59.768846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 362/729] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:19:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:19:59.774261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:19:59.882815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9eeffd-2837-4422-837e-fb7f4c1e5773 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:19:59.922107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c8121-a616-4e61-85ff-5b8b15fd0352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:19:59.923182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8121-a616-4e61-85ff-5b8b15fd0352 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:19:59.923660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8121-a616-4e61-85ff-5b8b15fd0352 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:19:59.924107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8121-a616-4e61-85ff-5b8b15fd0352 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:19:59.925140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c8121-a616-4e61-85ff-5b8b15fd0352 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:19:59.925632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c8121-a616-4e61-85ff-5b8b15fd0352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:19:59.927277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c8121-a616-4e61-85ff-5b8b15fd0352 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:19:59.950310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 368/730] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Apr 28 16:19:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:19:59.955969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:00.086326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681eb3fc-5e65-42dd-bcd7-0bbf8fbf60a7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:00.137345 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1e937-fed1-4532-a0d1-bcb217790722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:00.138006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1e937-fed1-4532-a0d1-bcb217790722 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.138290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1e937-fed1-4532-a0d1-bcb217790722 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.138580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1e937-fed1-4532-a0d1-bcb217790722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.208488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1e937-fed1-4532-a0d1-bcb217790722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:00.209957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1e937-fed1-4532-a0d1-bcb217790722 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:00.244156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b487-66b6-49c5-b7e0-de145e10c060 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.244485 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b487-66b6-49c5-b7e0-de145e10c060 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.244773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060b487-66b6-49c5-b7e0-de145e10c060 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.246130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 369/731] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:00.251555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0f91-bc90-4a59-b45c-b9375017caa4 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.251841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0f91-bc90-4a59-b45c-b9375017caa4 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.252123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d0f91-bc90-4a59-b45c-b9375017caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.276348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e89d0f91-bc90-4a59-b45c-b9375017caa4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:00.277596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e89d0f91-bc90-4a59-b45c-b9375017caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:00.365091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 363/732] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:19:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 28 16:20:00.371079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1e937-fed1-4532-a0d1-bcb217790722 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:00.403509 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 370/733] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 28 16:20:00.437981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d0f91-bc90-4a59-b45c-b9375017caa4 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:00.516258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1e937-fed1-4532-a0d1-bcb217790722 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:00.575669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef347445-c044-4503-98be-d9431a6de8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:00.576471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347445-c044-4503-98be-d9431a6de8de None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.576753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347445-c044-4503-98be-d9431a6de8de None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.577028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347445-c044-4503-98be-d9431a6de8de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.591907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef347445-c044-4503-98be-d9431a6de8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:00.593052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d0f91-bc90-4a59-b45c-b9375017caa4 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:00.593485 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef347445-c044-4503-98be-d9431a6de8de None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:00.615562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-ef347445-c044-4503-98be-d9431a6de8de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:00.617675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 364/734] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:00.619332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d803-6701-42c1-a8a7-d806f7a7b2ca None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.619619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d803-6701-42c1-a8a7-d806f7a7b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.620217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55d803-6701-42c1-a8a7-d806f7a7b2ca None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.622784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 365/735] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:00.624136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d803-6701-42c1-a8a7-d806f7a7b2ca None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:00.636475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a10b0-796f-4691-9bb4-612e44484c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:00.637331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a10b0-796f-4691-9bb4-612e44484c9e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.637622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a10b0-796f-4691-9bb4-612e44484c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.637903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a10b0-796f-4691-9bb4-612e44484c9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.655468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a10b0-796f-4691-9bb4-612e44484c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:00.662633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-478a10b0-796f-4691-9bb4-612e44484c9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:20:00.664181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 371/736] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:00.665421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba28b8-7f36-4540-a88a-236378ba8971 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.665716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba28b8-7f36-4540-a88a-236378ba8971 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.666007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba28b8-7f36-4540-a88a-236378ba8971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.683376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-15ba28b8-7f36-4540-a88a-236378ba8971 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:00.684980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-15ba28b8-7f36-4540-a88a-236378ba8971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:00.754893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55d803-6701-42c1-a8a7-d806f7a7b2ca None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:00.758792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 372/737] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 28 16:20:00.759730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba28b8-7f36-4540-a88a-236378ba8971 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:00.800171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:00.801251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.801679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.801976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.803002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:00.803315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:00.805374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:00.820415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 366/738] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:00.821635 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:00.875388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba28b8-7f36-4540-a88a-236378ba8971 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:00.908893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:00.909946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.910449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.910961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.911918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:00.912502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:00.914090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:00.924626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 373/739] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:00.925802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:00.952023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3c01-877f-402f-b354-2b8b953cd21b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:00.987809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336de82-f76e-46fd-8dc4-33c210dd3a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:00.988865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336de82-f76e-46fd-8dc4-33c210dd3a73 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:00.989368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336de82-f76e-46fd-8dc4-33c210dd3a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:00.989903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336de82-f76e-46fd-8dc4-33c210dd3a73 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:00.990951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336de82-f76e-46fd-8dc4-33c210dd3a73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:00.992594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336de82-f76e-46fd-8dc4-33c210dd3a73 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:01.041541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72a2bd-cb33-4bcb-818f-fff4651cd9f6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:01.082649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 367/740] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:20:00 2022] POST /identity/v3/services => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:01.082649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336de82-f76e-46fd-8dc4-33c210dd3a73 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:01.094464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:01.095413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.095707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.095983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.112638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:01.114125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:01.149922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:01.153850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 374/741] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:01.159688 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:01.262635 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336de82-f76e-46fd-8dc4-33c210dd3a73 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:01.288354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b2cd7-345d-41ee-a055-f56a834ca334 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:01.298693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:01.299486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.299775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.300072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.318661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:01.318661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:01.333468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:01.333468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 368/742] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:01.340046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:01.349780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:01.350995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.351479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.351950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.352946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:01.353454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:01.355234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:01.369181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 375/743] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:01.375323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:01.459776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e8833-b2ed-40fa-991b-0fd6c4147e7a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:01.500362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6385ef3-f5aa-4d7e-ba73-9613cd187ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:01.501039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385ef3-f5aa-4d7e-ba73-9613cd187ecf None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.501145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375e087-6e0a-4a23-9748-3a1c6bfed15d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:01.501325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385ef3-f5aa-4d7e-ba73-9613cd187ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.501610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385ef3-f5aa-4d7e-ba73-9613cd187ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.502346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6385ef3-f5aa-4d7e-ba73-9613cd187ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:01.502851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6385ef3-f5aa-4d7e-ba73-9613cd187ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:01.505038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6385ef3-f5aa-4d7e-ba73-9613cd187ecf None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:01.519965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 369/744] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:01.521585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a3aa6-9180-45e1-958d-8853daa87113 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.521877 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a3aa6-9180-45e1-958d-8853daa87113 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.522157 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a3aa6-9180-45e1-958d-8853daa87113 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.524089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 370/745] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:01.527376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a3aa6-9180-45e1-958d-8853daa87113 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:01.543810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2ade3-b1bc-420f-9505-a157320b6294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:01.544701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ade3-b1bc-420f-9505-a157320b6294 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.544996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ade3-b1bc-420f-9505-a157320b6294 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.545713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ade3-b1bc-420f-9505-a157320b6294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.546899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2ade3-b1bc-420f-9505-a157320b6294 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=6f397f35533540c6b92f0f4fe220d565) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:01.547223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2ade3-b1bc-420f-9505-a157320b6294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:01.549233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2ade3-b1bc-420f-9505-a157320b6294 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:01.557188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 376/746] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:01 2022] GET /identity/v3/role_assignments?user.id=6f397f35533540c6b92f0f4fe220d565&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:01.559732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6840-0494-43df-8d59-46f5d5f6f855 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.560022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6840-0494-43df-8d59-46f5d5f6f855 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.560302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6840-0494-43df-8d59-46f5d5f6f855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.582926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-5d6c6840-0494-43df-8d59-46f5d5f6f855 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:01.584151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5d6c6840-0494-43df-8d59-46f5d5f6f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:01.658009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 377/747] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:01.681526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c6840-0494-43df-8d59-46f5d5f6f855 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:01.735915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a3aa6-9180-45e1-958d-8853daa87113 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:01.792069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:01.792878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.793169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.793497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.793594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c6840-0494-43df-8d59-46f5d5f6f855 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:01.802100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:01.803937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:01.819729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:20:01.821324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 371/748] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:20:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:01.827262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:01.842878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377022f-0da2-46b2-95d5-773cd8471111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:01.843749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377022f-0da2-46b2-95d5-773cd8471111 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:01.844042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377022f-0da2-46b2-95d5-773cd8471111 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:01.844322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377022f-0da2-46b2-95d5-773cd8471111 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:01.866259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377022f-0da2-46b2-95d5-773cd8471111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:01.882661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-2377022f-0da2-46b2-95d5-773cd8471111 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:20:01.887750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 378/749] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:20:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:01.890190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377022f-0da2-46b2-95d5-773cd8471111 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.017635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377022f-0da2-46b2-95d5-773cd8471111 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.030585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14473d-25a2-4300-bc20-ced70006afc2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.090924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.091981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.093239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.093725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.096086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:02.096620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.099150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.111010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.111983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.112532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.113024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.114063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:02.114595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.116204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.118479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 379/750] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:20:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:02.126995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.155055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 372/751] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:20:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:02.160750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.282120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fbdb2-15e7-43e4-9dd3-008baf7cc73c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.312520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c2fe6-9538-448a-a221-bf998ef8971f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.317951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0852b3a-3dba-47e1-8cf1-1396015f9c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.318778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852b3a-3dba-47e1-8cf1-1396015f9c44 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.319169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852b3a-3dba-47e1-8cf1-1396015f9c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.319475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852b3a-3dba-47e1-8cf1-1396015f9c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.330063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0852b3a-3dba-47e1-8cf1-1396015f9c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.331661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0852b3a-3dba-47e1-8cf1-1396015f9c44 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.347803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-c0852b3a-3dba-47e1-8cf1-1396015f9c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:02.349401 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 380/752] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:02.350688 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01198-9bbb-4a5b-92ca-0990faa073d0 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.350976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01198-9bbb-4a5b-92ca-0990faa073d0 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.351315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf01198-9bbb-4a5b-92ca-0990faa073d0 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.352792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 381/753] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:02.359467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef16b-aa88-4e8e-903c-f33c1fe01cfa None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.359756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef16b-aa88-4e8e-903c-f33c1fe01cfa None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.360037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef16b-aa88-4e8e-903c-f33c1fe01cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.372487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.373876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.374399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.374996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.376914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-703ef16b-aa88-4e8e-903c-f33c1fe01cfa None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:02.378357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-703ef16b-aa88-4e8e-903c-f33c1fe01cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:02.387899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.390491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.417810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:02.420235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 373/754] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:02.421668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.454686 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 382/755] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:02.456005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ef16b-aa88-4e8e-903c-f33c1fe01cfa None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.534005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70b9b5-9b7b-4806-b0de-9d431ccb9b6f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.569444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.570091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.570380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.570747 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.571510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:02.571871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.573473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.580491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ef16b-aa88-4e8e-903c-f33c1fe01cfa None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.589526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 374/756] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:02.590964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.624497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.625281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.625494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.625797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.626508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:02.626886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.628412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.643270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 383/757] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:02.644362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.708201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df168ac0-fbdf-4bb8-b11a-8133f48db78d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.747078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.747943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.748234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.748511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.749420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.750571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.762297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 28 16:20:02.763566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 375/758] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:02.769139 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.771913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ba9ef-65de-49cc-a98a-e46850e7a2a8 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.811628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.812796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.813292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.813760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.821751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.823510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.838371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 16:20:02.845090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 384/759] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:02.846129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.875059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44216d6b-d615-46a1-93c8-b2741866601d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.908909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.909756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.910042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.910363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.917337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.918757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.933009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:02.934660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 376/760] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:02.935566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:02.951156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cecbf-612a-4e7e-88e4-67e5744facb8 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:02.987817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:02.988938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:02.989422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:02.989892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:02.990820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:02.991325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:02.992900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:02.997921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 385/761] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:02.998984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:03.040877 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2ed9f-3eaa-4288-ab7f-d5f29588433f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.078077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.078743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.078989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.079328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.080110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:03.080419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.081843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.104258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 377/762] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:03.104258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:03.127333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f74c91-fb0f-4cf1-922b-c787b03663a0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.166283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.166998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.167360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.167652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.168492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:03.168804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.170338 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.183715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 386/763] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:03.185292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:03.218019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96cda2-a544-4789-9747-28357ae2db6f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.259600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.260400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.260684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.260968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.261756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:03.263215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.265036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.274618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 378/764] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Apr 28 16:20:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:03.275655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:03.288380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adeb962-112d-43e1-87c5-808b27141d53 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.329398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0b72-f01c-4978-b014-e74b10faa2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.329992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0b72-f01c-4978-b014-e74b10faa2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.330291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0b72-f01c-4978-b014-e74b10faa2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.330603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0b72-f01c-4978-b014-e74b10faa2a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.386675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b07b4-a832-4485-8e4a-c4aa98991f7a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.399962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df0b72-f01c-4978-b014-e74b10faa2a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.401445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df0b72-f01c-4978-b014-e74b10faa2a1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.426928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00b96b-7557-4e20-8b69-6b0bfc949bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.428420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00b96b-7557-4e20-8b69-6b0bfc949bb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.428924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00b96b-7557-4e20-8b69-6b0bfc949bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.429389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00b96b-7557-4e20-8b69-6b0bfc949bb7 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/5b28dcc32b984429939b95e436b4d41e/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.431603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00b96b-7557-4e20-8b69-6b0bfc949bb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=5b28dcc32b984429939b95e436b4d41e, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.433252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00b96b-7557-4e20-8b69-6b0bfc949bb7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.504917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 387/765] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:03.504917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0b72-f01c-4978-b014-e74b10faa2a1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:03.532810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 379/766] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:20:03 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/5b28dcc32b984429939b95e436b4d41e/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:20:03.534388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00b96b-7557-4e20-8b69-6b0bfc949bb7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:03.659721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00b96b-7557-4e20-8b69-6b0bfc949bb7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.700790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.702083 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.702562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.703151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.712929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0b72-f01c-4978-b014-e74b10faa2a1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.716049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.717891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.738690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:03.741056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 380/767] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:03.747651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:03.777137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739c21-ff25-4480-96c1-5e2fbf549dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.779535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739c21-ff25-4480-96c1-5e2fbf549dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.780396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739c21-ff25-4480-96c1-5e2fbf549dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.780884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739c21-ff25-4480-96c1-5e2fbf549dd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.782656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739c21-ff25-4480-96c1-5e2fbf549dd7 None admin] RBAC: Adding query filter params (interface=public, service_id=3b2533d56708430093f393d8ffd1804c, region_id=RegionOne) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:03.783302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739c21-ff25-4480-96c1-5e2fbf549dd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.785628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6739c21-ff25-4480-96c1-5e2fbf549dd7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.801861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 388/768] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Apr 28 16:20:03 2022] GET /identity/v3/endpoints?service_id=3b2533d56708430093f393d8ffd1804c&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:03.804513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ba6b9-03bb-4ed0-9d35-f39e720fd6c9 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.805325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ba6b9-03bb-4ed0-9d35-f39e720fd6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.805818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ba6b9-03bb-4ed0-9d35-f39e720fd6c9 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.810353 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 389/769] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:03.811671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ba6b9-03bb-4ed0-9d35-f39e720fd6c9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:03.873476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b597315-9a04-45a4-992b-9e7278b75ad6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.907161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecafbd3-266d-43cb-9ae5-326403c4736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.907907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafbd3-266d-43cb-9ae5-326403c4736d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.908166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafbd3-266d-43cb-9ae5-326403c4736d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.908498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafbd3-266d-43cb-9ae5-326403c4736d None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.909232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecafbd3-266d-43cb-9ae5-326403c4736d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:03.909543 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecafbd3-266d-43cb-9ae5-326403c4736d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.911003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecafbd3-266d-43cb-9ae5-326403c4736d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.923216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 381/770] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:03.928801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5fae-c7a7-488f-b4dd-4484049495dc None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.928801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5fae-c7a7-488f-b4dd-4484049495dc None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.928801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5fae-c7a7-488f-b4dd-4484049495dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.942380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-4b1f5fae-c7a7-488f-b4dd-4484049495dc None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:03.943691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4b1f5fae-c7a7-488f-b4dd-4484049495dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:03.950239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ba6b9-03bb-4ed0-9d35-f39e720fd6c9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:03.987134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84a76b-5e11-44c6-af77-4479c8912bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:03.987804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a76b-5e11-44c6-af77-4479c8912bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:03.988089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a76b-5e11-44c6-af77-4479c8912bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:03.988982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84a76b-5e11-44c6-af77-4479c8912bc4 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:03.989091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84a76b-5e11-44c6-af77-4479c8912bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:03.990410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84a76b-5e11-44c6-af77-4479c8912bc4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:03.995616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 390/771] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:20:03 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:03.998572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84a76b-5e11-44c6-af77-4479c8912bc4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.046937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 382/772] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:04.048954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ab4b-cfc5-4ebe-9576-cd334f32c7e8 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.048954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ab4b-cfc5-4ebe-9576-cd334f32c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.049081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33ab4b-cfc5-4ebe-9576-cd334f32c7e8 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.051695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 383/773] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:04.059325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda975f-6df1-4016-9681-41917aa926f1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.060005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda975f-6df1-4016-9681-41917aa926f1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.060479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda975f-6df1-4016-9681-41917aa926f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.085294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6eda975f-6df1-4016-9681-41917aa926f1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:04.086511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6eda975f-6df1-4016-9681-41917aa926f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:04.141446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84a76b-5e11-44c6-af77-4479c8912bc4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.180226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.180565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 384/774] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:04.181052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.181343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.181620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.182384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda975f-6df1-4016-9681-41917aa926f1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.188779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:04.190293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:04.204795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:04.206998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 391/775] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:04.207375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.317754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda975f-6df1-4016-9681-41917aa926f1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.317949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd617f5-7f3b-4a5a-90f4-3c096c5f43b2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.352388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08509349-9861-4d8c-bf94-798c63854c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.353191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509349-9861-4d8c-bf94-798c63854c71 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.353479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509349-9861-4d8c-bf94-798c63854c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.353760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509349-9861-4d8c-bf94-798c63854c71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.363454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.364258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.364543 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.364822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] PATH_INFO: `/v3/services/network` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.365781 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:04.366179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08509349-9861-4d8c-bf94-798c63854c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:04.367285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:04.373960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-08509349-9861-4d8c-bf94-798c63854c71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:20:04.375942 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 392/776] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:04.376935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08509349-9861-4d8c-bf94-798c63854c71 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.378905 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 28 16:20:04.382687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 385/777] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:04.383847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.486572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe4e56-9b76-4c44-8415-481932b977ab None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.505210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08509349-9861-4d8c-bf94-798c63854c71 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.522497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.523532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.524031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.524538 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.525491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:04.526027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:04.527619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:04.537089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 386/778] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:04.538284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.539708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.540375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.540662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.540946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.542169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:04.542561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:04.544056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:04.557305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 393/779] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:04.558313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.640493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22260-075f-4943-8d0c-9cb88c3f3819 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.657753 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd704a-bdd9-474b-bbc7-96806af74ca0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.674923 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.675933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.676424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.676906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.678078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:04.678619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:04.680236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:04.690300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 387/780] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:04.691415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.693784 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.694662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.694954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.695235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.706332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:04.707818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:04.725355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:04.726945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 394/781] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:04.727928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.799560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4082-9e3e-4dc6-8d53-58da4642dbf3 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.832144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bdb7-0896-47ba-8e7c-b612c905bc6d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:04.836813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.837742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.838233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.838739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.839789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=86cf6adf3f29481793c254c056ddcadd) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:04.840346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:04.841995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:04.847959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 388/782] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/role_assignments?user.id=86cf6adf3f29481793c254c056ddcadd&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:04.848977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:04.908854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:04.909930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:04.911600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:04.912090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:04.913033 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] RBAC: Adding query filter params (type=network) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:04.914811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:04.918370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:04.929007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 395/783] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:04.934672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:05.026915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d07f5b-a181-4fc8-aa33-11e088f90e29 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:05.099213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:05.099891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:05.100178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:05.100455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:05.101501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:05.101501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:05.102885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:05.116863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 389/784] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:05.123670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:05.125973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685169-fb89-4932-9c40-ba3df507779f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:05.175293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:05.175997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:05.176278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:05.176562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:05.177637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] RBAC: Adding query filter params (interface=public, service_id=2f58157235a647458141e1f23d3ecece, region_id=RegionOne) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:05.177959 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:05.179379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:05.186049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 396/785] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Apr 28 16:20:04 2022] GET /identity/v3/endpoints?service_id=2f58157235a647458141e1f23d3ecece&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:05.190997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:05.308154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0425-95dd-42bb-b4e5-a6e2189b90e8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:05.367505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a067-3eb1-46bd-937d-80812af13daa None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:05.384291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:05.385123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:05.385422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:05.385676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:05.402136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:05.404441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:05.407030 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2a457-cb2d-4a58-8e76-a0230c74c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:05.408131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a457-cb2d-4a58-8e76-a0230c74c03c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:05.409750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a457-cb2d-4a58-8e76-a0230c74c03c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:05.410267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2a457-cb2d-4a58-8e76-a0230c74c03c None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:05.411934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2a457-cb2d-4a58-8e76-a0230c74c03c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:05.417141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2a457-cb2d-4a58-8e76-a0230c74c03c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:05.425656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 397/786] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:20:05 2022] GET /identity/v3/services => generated 772 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:05.432774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 16:20:05.435355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 390/787] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:05.440816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2a457-cb2d-4a58-8e76-a0230c74c03c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:05.583675 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2a457-cb2d-4a58-8e76-a0230c74c03c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:05.625939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:05.627036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:05.627536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:05.628049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:05.629121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:05.629641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:05.632053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:05.654457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 398/788] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Apr 28 16:20:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:05.660035 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:05.769268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab355-ab7d-434a-9971-f48cb7380d99 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:05.810308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168cf4-500c-497a-b32e-40d9eadd261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:05.811213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168cf4-500c-497a-b32e-40d9eadd261a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:05.811503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168cf4-500c-497a-b32e-40d9eadd261a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:05.811778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168cf4-500c-497a-b32e-40d9eadd261a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:05.823585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80168cf4-500c-497a-b32e-40d9eadd261a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:05.825613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80168cf4-500c-497a-b32e-40d9eadd261a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:05.854158 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-80168cf4-500c-497a-b32e-40d9eadd261a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:05.855879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 391/789] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:05.861557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:05.986918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6fffa-7efb-4537-aec2-fdf133ebe1ed None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:06.021888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931942-36fd-4d3a-b300-997f078b0e67 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.022191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931942-36fd-4d3a-b300-997f078b0e67 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.022451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931942-36fd-4d3a-b300-997f078b0e67 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.024143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 392/790] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:06.031881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945b0c6-dcc2-40ac-9307-6aa3ccec665d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.032472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945b0c6-dcc2-40ac-9307-6aa3ccec665d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.032472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945b0c6-dcc2-40ac-9307-6aa3ccec665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.033944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:06.034893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.035417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.035909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.042304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:06.049114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:06.050776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:06.063923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 399/791] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:06.074560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b945b0c6-dcc2-40ac-9307-6aa3ccec665d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:06.074560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b945b0c6-dcc2-40ac-9307-6aa3ccec665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:06.075923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:06.143124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 393/792] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:06.187563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945b0c6-dcc2-40ac-9307-6aa3ccec665d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:06.296596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c5ba0-7c45-43c8-9b59-ecfe135eb0e9 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:06.302890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945b0c6-dcc2-40ac-9307-6aa3ccec665d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:06.348651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84ecf-e783-485f-aaef-f8255e9764f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:06.349461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84ecf-e783-485f-aaef-f8255e9764f5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.349749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84ecf-e783-485f-aaef-f8255e9764f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.350027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84ecf-e783-485f-aaef-f8255e9764f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.371259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e84ecf-e783-485f-aaef-f8255e9764f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:06.380259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-f7e84ecf-e783-485f-aaef-f8255e9764f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:20:06.382178 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:06.383071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.383359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.383635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.391221 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:06.392673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:06.393060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 394/793] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:06.393908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84ecf-e783-485f-aaef-f8255e9764f5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:06.419021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:06.426954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 400/794] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:06.444986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:06.510994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84ecf-e783-485f-aaef-f8255e9764f5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:06.554362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009769e-4631-4dc3-ac98-3cec631266af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:06.555281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009769e-4631-4dc3-ac98-3cec631266af None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.555831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009769e-4631-4dc3-ac98-3cec631266af None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.556115 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009769e-4631-4dc3-ac98-3cec631266af None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.556872 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009769e-4631-4dc3-ac98-3cec631266af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:06.557178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009769e-4631-4dc3-ac98-3cec631266af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:06.557872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4af0e-6a9a-456b-aea5-5645b6cc8b08 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:06.558560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009769e-4631-4dc3-ac98-3cec631266af None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:06.569378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 395/795] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:06.571056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04214a5-b203-435e-b6b1-357eb4a2202d None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.571505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04214a5-b203-435e-b6b1-357eb4a2202d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.571795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04214a5-b203-435e-b6b1-357eb4a2202d None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.574072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 396/796] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:06.575587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04214a5-b203-435e-b6b1-357eb4a2202d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:06.603722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105522-a071-4d48-a618-5c4aba652a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:06.604409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105522-a071-4d48-a618-5c4aba652a52 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.604839 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105522-a071-4d48-a618-5c4aba652a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.605266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105522-a071-4d48-a618-5c4aba652a52 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.606161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9105522-a071-4d48-a618-5c4aba652a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:06.606479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9105522-a071-4d48-a618-5c4aba652a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:06.608837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9105522-a071-4d48-a618-5c4aba652a52 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:06.628550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 401/797] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:06.628550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef60cb-4e8e-4765-a517-46211a644d36 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.628550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef60cb-4e8e-4765-a517-46211a644d36 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.628550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef60cb-4e8e-4765-a517-46211a644d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.645724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a1ef60cb-4e8e-4765-a517-46211a644d36 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:06.646978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a1ef60cb-4e8e-4765-a517-46211a644d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:06.698479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04214a5-b203-435e-b6b1-357eb4a2202d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:06.727724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 402/798] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:06.728606 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef60cb-4e8e-4765-a517-46211a644d36 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:06.735045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:06.736110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.736639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.737501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.751145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:06.753088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:06.775298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:06.777521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 397/799] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:06.778973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:06.834802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef60cb-4e8e-4765-a517-46211a644d36 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:06.869438 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e888b0c-92e7-45c6-8b92-907152a2e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:06.871171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e888b0c-92e7-45c6-8b92-907152a2e3f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.872235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e888b0c-92e7-45c6-8b92-907152a2e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.872714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e888b0c-92e7-45c6-8b92-907152a2e3f7 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/6f397f35533540c6b92f0f4fe220d565/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.875049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e888b0c-92e7-45c6-8b92-907152a2e3f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=6f397f35533540c6b92f0f4fe220d565, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:06.876747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e888b0c-92e7-45c6-8b92-907152a2e3f7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:06.898005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd8ced-dcf2-4b9d-994d-647125ae8f97 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:06.931317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:06.932136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:06.932423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:06.932701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:06.933367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:06.935363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:06.946811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 28 16:20:06.948399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 398/800] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Apr 28 16:20:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:06.954002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:06.954343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 403/801] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:20:06 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/6f397f35533540c6b92f0f4fe220d565/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:20:06.956113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e888b0c-92e7-45c6-8b92-907152a2e3f7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:07.153134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293629c2-0da7-4997-b9ce-ad5901805a87 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:07.157748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e888b0c-92e7-45c6-8b92-907152a2e3f7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:07.211673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:07.212614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.213040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.213333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.214072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:07.214381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:07.217029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:07.220925 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:07.221645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.221934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.222266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.223018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:07.223330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:07.225214 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:07.231971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 399/802] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:07.233811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 404/803] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Apr 28 16:20:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:07.237532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:07.241140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:07.341438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd5849-d8c6-4d43-b6e2-97781117f6bf None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:07.345926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b458b1-6649-43ae-96e0-edfff761b8b5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:07.376977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:07.377547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.377835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.378110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.382734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:07.383664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.384164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.384644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.385516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:07.385774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:07.386291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:07.387522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:07.388815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:07.394494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 405/804] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Apr 28 16:20:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:07.400129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:07.403548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:20:07.405280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 400/805] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:20:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:07.410341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:07.504482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b5f9-8016-49fd-88e0-22db5117c455 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:07.513335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadc9d-46db-4b89-95a5-41446a320479 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:07.544579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355ba5f-0fb2-4957-b437-5c7eeef1475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:07.545310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ba5f-0fb2-4957-b437-5c7eeef1475c None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.545744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ba5f-0fb2-4957-b437-5c7eeef1475c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.545921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ba5f-0fb2-4957-b437-5c7eeef1475c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.546737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355ba5f-0fb2-4957-b437-5c7eeef1475c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:07.548040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355ba5f-0fb2-4957-b437-5c7eeef1475c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:07.551387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd975a-5187-411d-ba38-49ef957d37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:07.552956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd975a-5187-411d-ba38-49ef957d37cb None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.553424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd975a-5187-411d-ba38-49ef957d37cb None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.554148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd975a-5187-411d-ba38-49ef957d37cb None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.555322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd975a-5187-411d-ba38-49ef957d37cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:07.555811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd975a-5187-411d-ba38-49ef957d37cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:07.557552 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd975a-5187-411d-ba38-49ef957d37cb None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:07.575859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 401/806] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:20:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:07.577432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e012a4-dfec-47cc-bfbb-160521522104 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.577911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e012a4-dfec-47cc-bfbb-160521522104 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.578351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e012a4-dfec-47cc-bfbb-160521522104 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.580024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 402/807] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:07.581346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e012a4-dfec-47cc-bfbb-160521522104 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:07.670618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 406/808] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:20:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:20:07.672029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d721-4f12-41d4-ae8e-6a867d4b2ed8 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.672401 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d721-4f12-41d4-ae8e-6a867d4b2ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.673751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d721-4f12-41d4-ae8e-6a867d4b2ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.710105 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1651d721-4f12-41d4-ae8e-6a867d4b2ed8 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:07.711368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1651d721-4f12-41d4-ae8e-6a867d4b2ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:07.724968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e012a4-dfec-47cc-bfbb-160521522104 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:07.780734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bf59-c52e-4f2b-9905-49ceffa7ef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:07.781796 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bf59-c52e-4f2b-9905-49ceffa7ef21 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:07.782296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bf59-c52e-4f2b-9905-49ceffa7ef21 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:07.782794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bf59-c52e-4f2b-9905-49ceffa7ef21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:07.831908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 407/809] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:07.862293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651d721-4f12-41d4-ae8e-6a867d4b2ed8 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:07.889756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4bf59-c52e-4f2b-9905-49ceffa7ef21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:07.891559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4bf59-c52e-4f2b-9905-49ceffa7ef21 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:07.975233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651d721-4f12-41d4-ae8e-6a867d4b2ed8 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:08.009239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 403/810] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:08.015521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bf59-c52e-4f2b-9905-49ceffa7ef21 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.021214 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61e81-1387-4093-9627-3fa6d2c811bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:08.022036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61e81-1387-4093-9627-3fa6d2c811bf None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.022323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61e81-1387-4093-9627-3fa6d2c811bf None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.022626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61e81-1387-4093-9627-3fa6d2c811bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.040052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61e81-1387-4093-9627-3fa6d2c811bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:08.047718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-f3a61e81-1387-4093-9627-3fa6d2c811bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:20:08.054717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 408/811] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:20:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:08.058569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61e81-1387-4093-9627-3fa6d2c811bf None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.183035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61e81-1387-4093-9627-3fa6d2c811bf None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:08.220593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:08.221292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.221578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.221857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.222665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:08.222981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:08.224414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:08.230370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bf59-c52e-4f2b-9905-49ceffa7ef21 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:08.247445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 409/812] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:08.255548 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.297751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:08.298723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.299068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.299346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.316896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:08.319137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:08.352229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:08.353641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 404/813] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:08.361034 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.440496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ebc11-d0e5-4b50-8045-caa31a776f72 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:08.481619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fab44-ae06-4d01-97a5-03344cb00d06 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:08.483042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fff21-9631-41ef-adb8-0efd07bbf2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:08.484918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fff21-9631-41ef-adb8-0efd07bbf2bb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.485391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fff21-9631-41ef-adb8-0efd07bbf2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.485905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fff21-9631-41ef-adb8-0efd07bbf2bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.499284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fff21-9631-41ef-adb8-0efd07bbf2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:08.500909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fff21-9631-41ef-adb8-0efd07bbf2bb None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:08.514817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8feba-8a0f-404d-8c86-069d489c60f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:08.515673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8feba-8a0f-404d-8c86-069d489c60f8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.516098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8feba-8a0f-404d-8c86-069d489c60f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.516512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8feba-8a0f-404d-8c86-069d489c60f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.517366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8feba-8a0f-404d-8c86-069d489c60f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:08.517811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8feba-8a0f-404d-8c86-069d489c60f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:08.519372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8feba-8a0f-404d-8c86-069d489c60f8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:08.520548 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-237fff21-9631-41ef-adb8-0efd07bbf2bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:08.526765 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 410/814] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:08.526765 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b8a3-1847-4d13-a749-cb3f107b86dc None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.526765 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b8a3-1847-4d13-a749-cb3f107b86dc None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.526765 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b8a3-1847-4d13-a749-cb3f107b86dc None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.530216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 411/815] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:08.531150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6b8a3-1847-4d13-a749-cb3f107b86dc None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.538918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 405/816] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:08.540491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b802-60c5-43ce-a41b-063733a17bdf None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.540979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b802-60c5-43ce-a41b-063733a17bdf None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.541473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b802-60c5-43ce-a41b-063733a17bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.558866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-c4f1b802-60c5-43ce-a41b-063733a17bdf None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:08.560348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c4f1b802-60c5-43ce-a41b-063733a17bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:08.631370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 406/817] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:08.632561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b802-60c5-43ce-a41b-063733a17bdf None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.670215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6b8a3-1847-4d13-a749-cb3f107b86dc None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:08.714728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:08.716386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.716684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.716964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.717978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:08.718288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:08.720650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:08.736252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 412/818] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:08.737010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.755626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b802-60c5-43ce-a41b-063733a17bdf None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:08.800984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:08.802064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.802633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.802918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.811992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:08.813919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:08.831910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:08.834032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 407/819] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:08.834987 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.843175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a684d69-7d48-4997-b7f3-509617dcacc5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:08.878450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:08.879281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:08.879613 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:08.879890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] PATH_INFO: `/v3/services/network` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:08.880593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:08.881966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:08.893764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 28 16:20:08.895364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 413/820] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:08.896138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:08.959068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8865347-9732-4951-8d22-0cd0a9776497 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.001751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.002678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.003280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.003571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.005705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d38a-2956-43dc-959d-b825f2509e3e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.013233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.015164 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.034146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 16:20:09.036430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 408/821] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:09.037431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.047529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.048319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.048608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.048880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.049733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:09.050051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.060595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.069014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 414/822] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:09.069924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.149829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75568d61-9acc-4ff3-b48f-4fa15181b2b6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.185177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711b073-ef6a-4998-a887-5d4dd2d9e048 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.192408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.193528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.194003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.194430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.195680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:09.196140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.198279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.210012 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 409/823] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:09.210012 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.223837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.224867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.225326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.225860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.226956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:09.227500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.229173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.248358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 415/824] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Apr 28 16:20:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:09.249585 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.318511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4c14-991a-4d05-9d32-0caf07f87fa4 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.353506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.354461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.354916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.355361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.356379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=5b28dcc32b984429939b95e436b4d41e) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:09.356848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.358425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.364751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 410/825] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:09 2022] GET /identity/v3/role_assignments?user.id=5b28dcc32b984429939b95e436b4d41e&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:09.365786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.375284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e4f69-5e12-47f5-aeb3-f4a3b8761f11 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.414103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.415277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.415277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.415480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.416107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] RBAC: Adding query filter params (type=network) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:09.416417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.417862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.423884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 416/826] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:09.430737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.539137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e807b-7201-4732-949e-18d9b2005ce2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.584734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b1058-11a2-4658-894e-493a52d1024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.585780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1058-11a2-4658-894e-493a52d1024e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.586063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1058-11a2-4658-894e-493a52d1024e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.586338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b1058-11a2-4658-894e-493a52d1024e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.597745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b1058-11a2-4658-894e-493a52d1024e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.599286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b1058-11a2-4658-894e-493a52d1024e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.623261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-3b6b1058-11a2-4658-894e-493a52d1024e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:09.624784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 411/827] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:09.631234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154394d9-bc7f-4978-9ac3-102043f2c66c None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.631513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc684ea-b166-4732-8d31-2f99c062e93a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.631621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154394d9-bc7f-4978-9ac3-102043f2c66c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.631790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154394d9-bc7f-4978-9ac3-102043f2c66c None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.633360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 412/828] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:09.634093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154394d9-bc7f-4978-9ac3-102043f2c66c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.678098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7454a6-769b-414a-9632-4e89caa9a210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.678811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7454a6-769b-414a-9632-4e89caa9a210 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.679098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7454a6-769b-414a-9632-4e89caa9a210 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.679533 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7454a6-769b-414a-9632-4e89caa9a210 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.680288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7454a6-769b-414a-9632-4e89caa9a210 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.681654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7454a6-769b-414a-9632-4e89caa9a210 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.745981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154394d9-bc7f-4978-9ac3-102043f2c66c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.760585 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 417/829] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:20:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:09.762472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31d23-eaf0-4b55-bb22-4fa6fbb9fb1b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.762796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31d23-eaf0-4b55-bb22-4fa6fbb9fb1b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.763078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31d23-eaf0-4b55-bb22-4fa6fbb9fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.781680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-59a31d23-eaf0-4b55-bb22-4fa6fbb9fb1b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:09.782943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-59a31d23-eaf0-4b55-bb22-4fa6fbb9fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:09.807384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.808084 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.808377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.808886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.809411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:09.809769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.811309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:09.825203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 413/830] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:09.830802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.869141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 418/831] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:09.916206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31d23-eaf0-4b55-bb22-4fa6fbb9fb1b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:09.942705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb84e79-d45c-4467-b270-65d1706c5be2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:09.977731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:09.978643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:09.978976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:09.979259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:09.986990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:09.988452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.009524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:10.011144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 414/832] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:10.017170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.048949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31d23-eaf0-4b55-bb22-4fa6fbb9fb1b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.085327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e6f5-db44-460d-967d-4747e0172d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.086130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e6f5-db44-460d-967d-4747e0172d89 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.086416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e6f5-db44-460d-967d-4747e0172d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.086723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971e6f5-db44-460d-967d-4747e0172d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.096883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971e6f5-db44-460d-967d-4747e0172d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:10.104759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-8971e6f5-db44-460d-967d-4747e0172d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:20:10.106981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 419/833] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:10.112657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e6f5-db44-460d-967d-4747e0172d89 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.125330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad570556-e575-4011-b970-a0df35e919d3 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.159443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.160135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.160423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.160766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.161599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:10.161913 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.163452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.177613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 415/834] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:10.184384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.223826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971e6f5-db44-460d-967d-4747e0172d89 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.258132 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.258866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.259265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.302491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.302491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:10.302491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.302491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.302491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 420/835] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:10.302491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.311395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624af56-c026-4c7d-814c-8775058f123a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.360590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f4424-204f-456a-86a4-0921ad4324f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.362441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f4424-204f-456a-86a4-0921ad4324f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.362885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f4424-204f-456a-86a4-0921ad4324f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.363177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f4424-204f-456a-86a4-0921ad4324f9 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/86cf6adf3f29481793c254c056ddcadd/roles/b9f6881066644547b4a6bbe662963ab1` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.378922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f4424-204f-456a-86a4-0921ad4324f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=86cf6adf3f29481793c254c056ddcadd, role_id=b9f6881066644547b4a6bbe662963ab1)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.380294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f4424-204f-456a-86a4-0921ad4324f9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.396289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875d112-5a8e-4b2d-bc06-21286e3f77f2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.428821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.429607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.429887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.430155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.441111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.442560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.454576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 416/836] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:20:10 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/86cf6adf3f29481793c254c056ddcadd/roles/b9f6881066644547b4a6bbe662963ab1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:20:10.454576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dea68-177a-4752-a922-fed14ec2dd7d None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.454576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dea68-177a-4752-a922-fed14ec2dd7d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.454576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dea68-177a-4752-a922-fed14ec2dd7d None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.454576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 417/837] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:10.459441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200dab0-ca6c-4ef5-980a-0809740873e4 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.459809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200dab0-ca6c-4ef5-980a-0809740873e4 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.460204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200dab0-ca6c-4ef5-980a-0809740873e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.466434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:10.467772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 421/838] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:10.477898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.485419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-0200dab0-ca6c-4ef5-980a-0809740873e4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:10.486865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0200dab0-ca6c-4ef5-980a-0809740873e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:10.565625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 418/839] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:10.587089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200dab0-ca6c-4ef5-980a-0809740873e4 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.589251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc2b1d-b2ab-433c-afff-12e5037e6e94 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.629529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.630140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.630427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.630739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.631492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:10.631807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.633225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.651459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 422/840] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:10.652974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.702723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200dab0-ca6c-4ef5-980a-0809740873e4 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.748770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.750394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.751168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.751662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.752996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.755028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.758417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f369-729b-4a0d-bec9-e4a190e673c6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.769461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 28 16:20:10.772110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 419/841] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:10.778960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.800072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.800930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.801220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.801554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.809726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.811183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.825626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 28 16:20:10.831435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 423/842] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:10.832620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.880844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4be9f-6fd2-4ffb-9751-cc1005a4d77d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.913835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.914857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.915340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.915812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.916735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:10.917234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.919482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.929046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 420/843] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:10.930105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:10.936991 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5ead6-d6fc-4ad9-941c-164feadaf02c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:10.972192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:10.972899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:10.973190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:10.973473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:10.974317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:10.974661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:10.976100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:10.998164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 424/844] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:10.999471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:11.029461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f22f5-e5c8-4be2-924c-4b1e7507762d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:11.063994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6787144-1309-44f9-be16-45304411d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:11.064913 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6787144-1309-44f9-be16-45304411d719 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:11.065392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6787144-1309-44f9-be16-45304411d719 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:11.065878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6787144-1309-44f9-be16-45304411d719 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:11.066828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6787144-1309-44f9-be16-45304411d719 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:11.067331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6787144-1309-44f9-be16-45304411d719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:11.068869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6787144-1309-44f9-be16-45304411d719 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:11.078694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 421/845] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:11.102890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff836039-726a-43ee-8042-5aac7b28ff26 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:11.140837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857e8e2-da52-45a2-95ed-686c7cd51fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:11.141434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857e8e2-da52-45a2-95ed-686c7cd51fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:11.141724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857e8e2-da52-45a2-95ed-686c7cd51fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:11.142010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857e8e2-da52-45a2-95ed-686c7cd51fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:11.217911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857e8e2-da52-45a2-95ed-686c7cd51fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:11.219442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857e8e2-da52-45a2-95ed-686c7cd51fc6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:11.329985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 425/846] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:11.331417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6787144-1309-44f9-be16-45304411d719 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:11.434295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6787144-1309-44f9-be16-45304411d719 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:11.467523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:11.468323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:11.468606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:11.468879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:11.479344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:11.480839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:11.500645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:11.502170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 422/847] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:11.509273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857e8e2-da52-45a2-95ed-686c7cd51fc6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:11.611233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857e8e2-da52-45a2-95ed-686c7cd51fc6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:11.646611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:11.647612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:11.648124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:11.648608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:11.649540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:11.650072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:11.651670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:11.667972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 426/848] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:11.669740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:11.774446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d5639-5ecf-40a9-90f2-2cf06407190c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:11.812482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4154c7-cb09-4fbf-b739-bcf6481b3951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:11.813288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4154c7-cb09-4fbf-b739-bcf6481b3951 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:11.813600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4154c7-cb09-4fbf-b739-bcf6481b3951 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:11.813848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4154c7-cb09-4fbf-b739-bcf6481b3951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:11.822574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4154c7-cb09-4fbf-b739-bcf6481b3951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:11.822574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4154c7-cb09-4fbf-b739-bcf6481b3951 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:11.836849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-ec4154c7-cb09-4fbf-b739-bcf6481b3951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:11.836849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 423/849] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:11.847076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:11.905979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656170-1e13-412c-be3f-3ab7d4a9d0ed None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:11.906342 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656170-1e13-412c-be3f-3ab7d4a9d0ed None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:11.906570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656170-1e13-412c-be3f-3ab7d4a9d0ed None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:11.909792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 424/850] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:11.913130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f48eb7-d7fa-49b6-beef-528785536807 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:11.913407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f48eb7-d7fa-49b6-beef-528785536807 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:11.913697 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f48eb7-d7fa-49b6-beef-528785536807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:11.931191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-31f48eb7-d7fa-49b6-beef-528785536807 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:11.932385 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-31f48eb7-d7fa-49b6-beef-528785536807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:11.961003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eca89-d6e1-4ade-9aa7-22d6711f1b5c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:11.994698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:11.995409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:11.995695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:11.996023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:11.997381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:11.997701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:11.999184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:12.018595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 427/851] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:12.021517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:12.026880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 425/852] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:12.056029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f48eb7-d7fa-49b6-beef-528785536807 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:12.141382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29df03-b484-4378-b994-bbc11d61c002 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:12.157501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f48eb7-d7fa-49b6-beef-528785536807 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:12.176824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:12.177653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:12.178037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:12.178474 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:12.179366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=6f397f35533540c6b92f0f4fe220d565) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:12.179795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:12.181324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:12.195050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 428/853] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:12 2022] GET /identity/v3/role_assignments?user.id=6f397f35533540c6b92f0f4fe220d565&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:12.200205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:12.201295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:12.201733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:12.202180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:12.203059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:12.204651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:12.218010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 28 16:20:12.219993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 426/854] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Apr 28 16:20:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:12.225828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:12.343187 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a175-dbf1-4245-882b-359c1054f4e7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:12.382154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96476eb7-f2f8-47b6-9c00-1a2a9dc7ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:12.382876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476eb7-f2f8-47b6-9c00-1a2a9dc7ef62 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:12.383162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476eb7-f2f8-47b6-9c00-1a2a9dc7ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:12.383446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96476eb7-f2f8-47b6-9c00-1a2a9dc7ef62 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:12.384171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96476eb7-f2f8-47b6-9c00-1a2a9dc7ef62 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:12.384517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96476eb7-f2f8-47b6-9c00-1a2a9dc7ef62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:12.385869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96476eb7-f2f8-47b6-9c00-1a2a9dc7ef62 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:12.390790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 429/855] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:12.396201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:12.496677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c245129-dd5e-4e51-93cc-53d472733dc1 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:12.534132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c099dc-cc53-4bfe-8b6f-713f19f216a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:12.535172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c099dc-cc53-4bfe-8b6f-713f19f216a0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:12.535674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c099dc-cc53-4bfe-8b6f-713f19f216a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:12.536144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c099dc-cc53-4bfe-8b6f-713f19f216a0 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:12.537067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c099dc-cc53-4bfe-8b6f-713f19f216a0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:12.537567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c099dc-cc53-4bfe-8b6f-713f19f216a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:12.539140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c099dc-cc53-4bfe-8b6f-713f19f216a0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:12.544821 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 427/856] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:12.891690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ee17-be4a-42ae-a22f-e48a0e558c4d None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:12.892183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ee17-be4a-42ae-a22f-e48a0e558c4d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:12.892574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ee17-be4a-42ae-a22f-e48a0e558c4d None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:12.894296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 430/857] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:12.899528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305cd3-9783-425f-b6c0-5b00bc45d511 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:12.899951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305cd3-9783-425f-b6c0-5b00bc45d511 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:12.900330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305cd3-9783-425f-b6c0-5b00bc45d511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:12.917766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-8c305cd3-9783-425f-b6c0-5b00bc45d511 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:12.919020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8c305cd3-9783-425f-b6c0-5b00bc45d511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:12.987366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 428/858] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:13.010728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ee17-be4a-42ae-a22f-e48a0e558c4d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:13.112122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ee17-be4a-42ae-a22f-e48a0e558c4d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:13.146354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8db0a-6886-4ae2-a79d-b3c8a28cbe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:13.147096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8db0a-6886-4ae2-a79d-b3c8a28cbe0e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:13.147383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8db0a-6886-4ae2-a79d-b3c8a28cbe0e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:13.147657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8db0a-6886-4ae2-a79d-b3c8a28cbe0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:13.157590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8db0a-6886-4ae2-a79d-b3c8a28cbe0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:13.164655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-79e8db0a-6886-4ae2-a79d-b3c8a28cbe0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:20:13.166223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 431/859] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:20:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:13.172302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c305cd3-9783-425f-b6c0-5b00bc45d511 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:13.272994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c305cd3-9783-425f-b6c0-5b00bc45d511 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:13.306517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfef0e9-ba10-4c01-96ca-c30302bdbbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:13.307215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfef0e9-ba10-4c01-96ca-c30302bdbbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:13.307498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfef0e9-ba10-4c01-96ca-c30302bdbbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:13.307774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfef0e9-ba10-4c01-96ca-c30302bdbbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:13.308519 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfef0e9-ba10-4c01-96ca-c30302bdbbe8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:13.309353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfef0e9-ba10-4c01-96ca-c30302bdbbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:13.310750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfef0e9-ba10-4c01-96ca-c30302bdbbe8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:13.319027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 429/860] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:20:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:13.325053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8db0a-6886-4ae2-a79d-b3c8a28cbe0e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:13.366401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87123e-3a6e-479a-b1cd-6b0c3753f4fa None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:13.366730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87123e-3a6e-479a-b1cd-6b0c3753f4fa None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:13.366990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87123e-3a6e-479a-b1cd-6b0c3753f4fa None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:13.368459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 430/861] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:13.374090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dde30-7cbe-4142-8d27-ebf6d1a4994f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:13.374377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dde30-7cbe-4142-8d27-ebf6d1a4994f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:13.374686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dde30-7cbe-4142-8d27-ebf6d1a4994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:13.391235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b23dde30-7cbe-4142-8d27-ebf6d1a4994f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:13.392698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b23dde30-7cbe-4142-8d27-ebf6d1a4994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:13.440152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8db0a-6886-4ae2-a79d-b3c8a28cbe0e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:13.462583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 431/862] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:13.480084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:13.481804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:13.482286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:13.482807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:13.485129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dde30-7cbe-4142-8d27-ebf6d1a4994f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:13.497145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:13.498756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:13.515304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:13.516890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 432/863] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:13.522909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:13.591989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dde30-7cbe-4142-8d27-ebf6d1a4994f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:13.625750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4d3bc-21a3-429a-8019-0e27612e16e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:13.626551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d3bc-21a3-429a-8019-0e27612e16e8 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:13.626909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d3bc-21a3-429a-8019-0e27612e16e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:13.627265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4d3bc-21a3-429a-8019-0e27612e16e8 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:13.628083 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4d3bc-21a3-429a-8019-0e27612e16e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:13.629532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4d3bc-21a3-429a-8019-0e27612e16e8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:13.646078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c908492-c146-4cb6-905d-88324bd22e71 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:13.682011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:13.682732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:13.683018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:13.683295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:13.685040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:13.685040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:13.686427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:13.699513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 433/864] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:13.704879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:13.730411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 432/865] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:20:13 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:20:13.830104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74307e8-3b76-4633-97d7-47fdec2d5cb5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:13.875988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:13.877203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:13.877708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:13.878200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:13.886810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:13.888881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:13.905568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 16:20:13.907604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 434/866] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:20:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:13.915631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4d3bc-21a3-429a-8019-0e27612e16e8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:14.017370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4d3bc-21a3-429a-8019-0e27612e16e8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:14.054559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:14.054559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.054559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.054559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.054958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:14.054958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:14.056484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:14.075149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 433/867] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Apr 28 16:20:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:14.080694 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:14.183781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8589b6-bef6-451f-a67d-4097adf932af None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:14.219994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a70d3-9941-48e7-ad27-e7c5ff279fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:14.220654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a70d3-9941-48e7-ad27-e7c5ff279fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.220940 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a70d3-9941-48e7-ad27-e7c5ff279fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.221222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a70d3-9941-48e7-ad27-e7c5ff279fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.289967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a70d3-9941-48e7-ad27-e7c5ff279fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:14.291384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a70d3-9941-48e7-ad27-e7c5ff279fd6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:14.390265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 435/868] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:14 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:14.395791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:14.500236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce509e4-51be-4ac5-9b7c-561744c09e5d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:14.535497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f065d1-65db-43fa-8581-1302785e39e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:14.536308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f065d1-65db-43fa-8581-1302785e39e9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.536595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f065d1-65db-43fa-8581-1302785e39e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.536875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f065d1-65db-43fa-8581-1302785e39e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.547782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f065d1-65db-43fa-8581-1302785e39e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:14.549165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f065d1-65db-43fa-8581-1302785e39e9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:14.567972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-b4f065d1-65db-43fa-8581-1302785e39e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:14.569529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 434/869] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:14.575700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a70d3-9941-48e7-ad27-e7c5ff279fd6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:14.608997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12773a-de34-4da7-8c82-b99c67975b15 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.609658 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12773a-de34-4da7-8c82-b99c67975b15 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.609658 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12773a-de34-4da7-8c82-b99c67975b15 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.611171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 435/870] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:14.616025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753a9e-e839-4965-8124-25a65e759ebe None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.616311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753a9e-e839-4965-8124-25a65e759ebe None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.616587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753a9e-e839-4965-8124-25a65e759ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.633459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-94753a9e-e839-4965-8124-25a65e759ebe None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:14.634739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-94753a9e-e839-4965-8124-25a65e759ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:14.686426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a70d3-9941-48e7-ad27-e7c5ff279fd6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:14.717639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 436/871] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:14.732381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:14.733060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.733348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.733630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.734427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:14.734763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:14.736198 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:14.738959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94753a9e-e839-4965-8124-25a65e759ebe None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:14.749558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 436/872] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:14.754740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:14.843078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94753a9e-e839-4965-8124-25a65e759ebe None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:14.867456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1d42c-09c4-4915-97de-66d96ee439b2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:14.878710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98117d0-5b36-4a2b-8aef-6ea42088d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:14.879535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98117d0-5b36-4a2b-8aef-6ea42088d682 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.879820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98117d0-5b36-4a2b-8aef-6ea42088d682 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.880263 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98117d0-5b36-4a2b-8aef-6ea42088d682 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.880753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98117d0-5b36-4a2b-8aef-6ea42088d682 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:14.882126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98117d0-5b36-4a2b-8aef-6ea42088d682 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:14.896071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a98117d0-5b36-4a2b-8aef-6ea42088d682 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 16:20:14.897335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 437/873] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:14.902572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271deda-e306-4ca8-b9bc-9e4f4ac5d220 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.902572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271deda-e306-4ca8-b9bc-9e4f4ac5d220 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.902572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271deda-e306-4ca8-b9bc-9e4f4ac5d220 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.902572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 438/874] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:14.903108 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271deda-e306-4ca8-b9bc-9e4f4ac5d220 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:14.906428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7f5c8-babd-4579-90ae-376425d92860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:14.907292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f5c8-babd-4579-90ae-376425d92860 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.907581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f5c8-babd-4579-90ae-376425d92860 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.907863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7f5c8-babd-4579-90ae-376425d92860 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.914909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f5c8-babd-4579-90ae-376425d92860 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:14.916362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7f5c8-babd-4579-90ae-376425d92860 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:14.930893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-3ee7f5c8-babd-4579-90ae-376425d92860 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:14.932094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 437/875] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:14.933345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470915-bd10-4596-90b5-211b6626d127 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:14.933716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470915-bd10-4596-90b5-211b6626d127 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:14.934492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470915-bd10-4596-90b5-211b6626d127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:14.951102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-6b470915-bd10-4596-90b5-211b6626d127 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:14.952314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6b470915-bd10-4596-90b5-211b6626d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:15.013562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271deda-e306-4ca8-b9bc-9e4f4ac5d220 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:15.020150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 438/876] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:15.023475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b470915-bd10-4596-90b5-211b6626d127 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:15.065348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:15.066027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:15.066317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:15.066630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:15.067765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:15.068076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:15.069807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:15.080401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 439/877] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:15.080401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:15.124676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b470915-bd10-4596-90b5-211b6626d127 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:15.156020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:15.156677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:15.156959 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:15.157234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:15.158023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:15.158333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:15.159809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:15.175994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 439/878] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:15.175994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:15.186482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9fb69-f920-466d-b145-fcb6785ee073 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:15.219996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292c6b9-4c93-43aa-a7fd-b234dbec3f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:15.220783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c6b9-4c93-43aa-a7fd-b234dbec3f38 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:15.221131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c6b9-4c93-43aa-a7fd-b234dbec3f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:15.221492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292c6b9-4c93-43aa-a7fd-b234dbec3f38 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:15.222290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c6b9-4c93-43aa-a7fd-b234dbec3f38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:15.223777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292c6b9-4c93-43aa-a7fd-b234dbec3f38 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:15.269075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989498eb-9ad8-459b-a6f4-02d4c98e6d4d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:15.301758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:15.302735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:15.303025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:15.303304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:15.304015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:15.304321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:15.305683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:15.310354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 440/879] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:15.311202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:15.314230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 440/880] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:20:15 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:15.441912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1e066-1539-482d-b455-5f8fd34e232a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:15.488734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3d8a1-cace-40b9-9fcb-e61d1cab4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:15.489447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3d8a1-cace-40b9-9fcb-e61d1cab4dec None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:15.489733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3d8a1-cace-40b9-9fcb-e61d1cab4dec None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:15.490015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3d8a1-cace-40b9-9fcb-e61d1cab4dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:15.490929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3d8a1-cace-40b9-9fcb-e61d1cab4dec None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=86cf6adf3f29481793c254c056ddcadd) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:15.491248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3d8a1-cace-40b9-9fcb-e61d1cab4dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:15.492773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3d8a1-cace-40b9-9fcb-e61d1cab4dec None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:15.500207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 441/881] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:15 2022] GET /identity/v3/role_assignments?user.id=86cf6adf3f29481793c254c056ddcadd&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:16.117283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5dcd9-0fe2-48cf-8474-414e0c941743 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:16.118059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5dcd9-0fe2-48cf-8474-414e0c941743 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:16.118059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5dcd9-0fe2-48cf-8474-414e0c941743 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:16.119373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 441/882] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:16.127126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf772a1-f03c-472c-b47d-c89cc018f3d6 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:16.127126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf772a1-f03c-472c-b47d-c89cc018f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:16.127126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf772a1-f03c-472c-b47d-c89cc018f3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:16.143851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-3cf772a1-f03c-472c-b47d-c89cc018f3d6 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:16.145336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3cf772a1-f03c-472c-b47d-c89cc018f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:16.213671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 442/883] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:16.238457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5dcd9-0fe2-48cf-8474-414e0c941743 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:16.343889 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5dcd9-0fe2-48cf-8474-414e0c941743 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:16.379240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:16.380427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:16.380912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:16.381386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:16.382265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:16.383900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:16.395657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 28 16:20:16.397494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 442/884] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:16.403512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf772a1-f03c-472c-b47d-c89cc018f3d6 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:16.506513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf772a1-f03c-472c-b47d-c89cc018f3d6 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:16.542826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:16.544405 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:16.544900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:16.545375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:16.546285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:16.546835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:16.548507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:16.554017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 443/885] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:16.559811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:16.660586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14220c-77e2-4523-8e17-cb9577139e6f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:16.694458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:16.695464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:16.695949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:16.696423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:16.697328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:16.697845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:16.699983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:16.705367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 443/886] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:16.711409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:16.812603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e29528-8b70-44da-9e70-4938af49f66d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:16.846970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7fd50-a5be-4208-a3f1-86acf9f93ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:16.847943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7fd50-a5be-4208-a3f1-86acf9f93ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:16.848432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7fd50-a5be-4208-a3f1-86acf9f93ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:16.849024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7fd50-a5be-4208-a3f1-86acf9f93ad1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:16.850076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7fd50-a5be-4208-a3f1-86acf9f93ad1 None admin] RBAC: Adding query filter params (interface=public, service_id=4b67d65c4b2e4ab9b8be9fc99eceeb6c, region_id=RegionOne) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:16.850703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7fd50-a5be-4208-a3f1-86acf9f93ad1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:16.852439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7fd50-a5be-4208-a3f1-86acf9f93ad1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:16.858290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 444/887] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Apr 28 16:20:16 2022] GET /identity/v3/endpoints?service_id=4b67d65c4b2e4ab9b8be9fc99eceeb6c&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:16.864094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:16.964394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70e3b5-732c-468b-8571-acb535fd3633 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:16.998985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946525f0-efdd-4a26-9133-8f1c06b4e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:17.000045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946525f0-efdd-4a26-9133-8f1c06b4e1ac None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:17.000532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946525f0-efdd-4a26-9133-8f1c06b4e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:17.001067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946525f0-efdd-4a26-9133-8f1c06b4e1ac None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:17.001964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946525f0-efdd-4a26-9133-8f1c06b4e1ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:17.003580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946525f0-efdd-4a26-9133-8f1c06b4e1ac None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:17.009765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 444/888] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:20:16 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:20:17.647749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519d6f-9861-4aff-801a-60ccdd00e67a None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:17.648268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519d6f-9861-4aff-801a-60ccdd00e67a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:17.648385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41519d6f-9861-4aff-801a-60ccdd00e67a None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:17.650025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 445/889] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:17.655695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c1d1-59bd-4ed3-8f3d-c3536beb7b1c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:17.656525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c1d1-59bd-4ed3-8f3d-c3536beb7b1c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:17.657006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c1d1-59bd-4ed3-8f3d-c3536beb7b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:17.664471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467610b-0341-4a1e-9858-2afa753ef5f8 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:17.669563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467610b-0341-4a1e-9858-2afa753ef5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:17.669563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467610b-0341-4a1e-9858-2afa753ef5f8 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:17.669563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 446/890] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:17.673004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be117e-4c18-4852-aa1f-e108fc7fbdbe None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:17.673566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be117e-4c18-4852-aa1f-e108fc7fbdbe None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:17.674103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be117e-4c18-4852-aa1f-e108fc7fbdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:17.675380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f5e7c1d1-59bd-4ed3-8f3d-c3536beb7b1c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:17.676573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f5e7c1d1-59bd-4ed3-8f3d-c3536beb7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:17.692856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-00be117e-4c18-4852-aa1f-e108fc7fbdbe None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:17.694680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-00be117e-4c18-4852-aa1f-e108fc7fbdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:17.769024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 445/891] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:17.778556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 447/892] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:17.791656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7c1d1-59bd-4ed3-8f3d-c3536beb7b1c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:17.797139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be117e-4c18-4852-aa1f-e108fc7fbdbe None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:17.907895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be117e-4c18-4852-aa1f-e108fc7fbdbe None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:17.908219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7c1d1-59bd-4ed3-8f3d-c3536beb7b1c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:17.941589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a0701-9185-4b74-a3f3-2b775ca97fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:17.942270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a0701-9185-4b74-a3f3-2b775ca97fc7 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:17.942588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a0701-9185-4b74-a3f3-2b775ca97fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:17.942880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a0701-9185-4b74-a3f3-2b775ca97fc7 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:17.943622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a0701-9185-4b74-a3f3-2b775ca97fc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:17.945008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a0701-9185-4b74-a3f3-2b775ca97fc7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:17.947165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8bb04-6bc2-4028-b663-b9e7a476e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:17.948013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bb04-6bc2-4028-b663-b9e7a476e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:17.948301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bb04-6bc2-4028-b663-b9e7a476e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:17.948579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bb04-6bc2-4028-b663-b9e7a476e5b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:17.949767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8bb04-6bc2-4028-b663-b9e7a476e5b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:17.951156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8bb04-6bc2-4028-b663-b9e7a476e5b2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:17.962516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-48b8bb04-6bc2-4028-b663-b9e7a476e5b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 28 16:20:17.963917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 446/893] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Apr 28 16:20:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:17.965499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf15a8-d2d2-4d60-bd18-1bfcdf8d2e4b None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:17.965793 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf15a8-d2d2-4d60-bd18-1bfcdf8d2e4b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:17.966069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf15a8-d2d2-4d60-bd18-1bfcdf8d2e4b None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:17.967500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 447/894] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:17.970005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf15a8-d2d2-4d60-bd18-1bfcdf8d2e4b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:18.026865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 448/895] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:20:17 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:20:18.029559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de02d5-3e15-4c21-8ad0-6eae3780af7f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.029855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de02d5-3e15-4c21-8ad0-6eae3780af7f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.030635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de02d5-3e15-4c21-8ad0-6eae3780af7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.050997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d3de02d5-3e15-4c21-8ad0-6eae3780af7f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:18.053200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d3de02d5-3e15-4c21-8ad0-6eae3780af7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:18.097556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf15a8-d2d2-4d60-bd18-1bfcdf8d2e4b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:18.135268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:18.136349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.137391 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.137897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.138874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:18.139488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:18.141221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:18.147069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 449/896] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:18.147644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 448/897] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:18.158664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de02d5-3e15-4c21-8ad0-6eae3780af7f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:18.165421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:18.280026 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de02d5-3e15-4c21-8ad0-6eae3780af7f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:18.296186 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f604193-b4e2-42b5-9b35-2babae9d127f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:18.323597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:18.324624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.324918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.325261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.326319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:18.326668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:18.328562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:18.336502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d48e8e-0b83-46bd-a680-454e7407cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:18.337618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48e8e-0b83-46bd-a680-454e7407cb90 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.338103 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48e8e-0b83-46bd-a680-454e7407cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.338605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48e8e-0b83-46bd-a680-454e7407cb90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.339519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 450/898] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:18.341112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:18.351367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d48e8e-0b83-46bd-a680-454e7407cb90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:18.362073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-63d48e8e-0b83-46bd-a680-454e7407cb90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 16:20:18.364241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 449/899] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Apr 28 16:20:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:18.370066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d48e8e-0b83-46bd-a680-454e7407cb90 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:18.463418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b4027-fcd4-4c76-a9c2-34b71ac142cc None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:18.474105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d48e8e-0b83-46bd-a680-454e7407cb90 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:18.498567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:18.499603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.499603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.499772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.500574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] RBAC: Adding query filter params (interface=public, service_id=df139f3b2e5744bd92b36a87b3e46e34, region_id=RegionOne) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:18.500892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:18.502278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:18.511901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 451/900] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Apr 28 16:20:18 2022] GET /identity/v3/endpoints?service_id=df139f3b2e5744bd92b36a87b3e46e34&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:18.512756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:18.517829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:18.518513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.518848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.519298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.520066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:18.520427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:18.521799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:18.538702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 450/901] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Apr 28 16:20:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:18.540194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:18.640102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453faaf2-4f18-4bae-a14a-40ad24082ed0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:18.647839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1fced-3f8d-46a3-a000-cc124ad3628c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:18.675150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8f4c-f328-4825-af1c-40a7e22f0860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:18.675821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8f4c-f328-4825-af1c-40a7e22f0860 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.676114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8f4c-f328-4825-af1c-40a7e22f0860 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.676398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8f4c-f328-4825-af1c-40a7e22f0860 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.677388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c8f4c-f328-4825-af1c-40a7e22f0860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:18.678740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c8f4c-f328-4825-af1c-40a7e22f0860 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:18.684413 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:18.685773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.686258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.686790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.690832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 452/902] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:20:18 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:20:18.699959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:18.701810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:18.721273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:18.723322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 451/903] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:18.729503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8f4c-f328-4825-af1c-40a7e22f0860 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:18.835239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8f4c-f328-4825-af1c-40a7e22f0860 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:18.876071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:18.876760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:18.877051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:18.877337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:18.878089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:18.878403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:18.879855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:18.893657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 453/904] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:18.899726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.004784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90108833-b194-4d24-92bc-7ef6bfda9225 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:19.037274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:19.038106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.038392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.038713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.048429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:19.049890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:19.064931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 16:20:19.066477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 452/905] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:20:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:19.072145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.175921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6539e-0c45-4e9b-ae85-90458efb041c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:19.210088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483cb71-35d5-45cd-9cf5-32bfc962cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:19.210793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cb71-35d5-45cd-9cf5-32bfc962cd69 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.211081 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cb71-35d5-45cd-9cf5-32bfc962cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.211359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483cb71-35d5-45cd-9cf5-32bfc962cd69 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.212204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483cb71-35d5-45cd-9cf5-32bfc962cd69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:19.212519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483cb71-35d5-45cd-9cf5-32bfc962cd69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:19.213950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483cb71-35d5-45cd-9cf5-32bfc962cd69 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:19.232486 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 454/906] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Apr 28 16:20:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:19.237980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.341125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1439d5-efbc-4b79-801f-09fe40f561fa None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:19.343727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b026256-99eb-4c37-8df0-f41fc9f72a24 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.344024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b026256-99eb-4c37-8df0-f41fc9f72a24 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.344303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b026256-99eb-4c37-8df0-f41fc9f72a24 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.345788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 455/907] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:19.351036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906ae41-93cd-4280-ad04-cb86bc183aab None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.351556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906ae41-93cd-4280-ad04-cb86bc183aab None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.352054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906ae41-93cd-4280-ad04-cb86bc183aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.369979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f906ae41-93cd-4280-ad04-cb86bc183aab None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:19.372052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f906ae41-93cd-4280-ad04-cb86bc183aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:19.380881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088085-d116-40ae-8957-5d6bc130a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:19.381542 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088085-d116-40ae-8957-5d6bc130a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.381828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088085-d116-40ae-8957-5d6bc130a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.382107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e088085-d116-40ae-8957-5d6bc130a9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.446898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 456/908] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:19.449631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e088085-d116-40ae-8957-5d6bc130a9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:19.451172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e088085-d116-40ae-8957-5d6bc130a9b6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:19.464043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906ae41-93cd-4280-ad04-cb86bc183aab None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.564275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 453/909] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:19.569821 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088085-d116-40ae-8957-5d6bc130a9b6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.586183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906ae41-93cd-4280-ad04-cb86bc183aab None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:19.622964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:19.624117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.624605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.625096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.625962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:19.627570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:19.640805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 28 16:20:19.642712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 457/910] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:19.648392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.669911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e088085-d116-40ae-8957-5d6bc130a9b6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:19.704378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:19.705332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.705508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.705720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.716493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:19.718134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:19.735600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:19.741350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 454/911] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:19.742273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.758115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2627681-2498-43de-9c55-90b36ebc1451 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:19.793768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:19.794786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.795292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.795766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.796683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:19.797379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:19.799042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:19.804804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 458/912] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:19.810185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.847847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5bdbb-aa9e-46e5-b4bb-850141d8ba2b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:19.883073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:19.884097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.884582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.885054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.886062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:19.886623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:19.888233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:19.900768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 455/913] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:19.907147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:19.921142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3733a-b39d-4a0a-a357-7ba131d9ea82 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:19.955653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:19.956263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:19.956551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:19.956834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:19.957544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:19.957862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:19.959342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:19.969405 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 459/914] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Apr 28 16:20:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:19.970362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:20.024100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb093c-521b-4719-882b-a93f0289cebb None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:20.070179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:20.071447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:20.071836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:20.072217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:20.081429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:20.083306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:20.094021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c0d5-dd91-4934-a469-8ccc75696795 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:20.100881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:20.106690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 456/915] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:20.109021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:20.137103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3593-6f4e-48e1-81ef-03ff25bbcf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:20.137709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3593-6f4e-48e1-81ef-03ff25bbcf7a None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:20.137996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3593-6f4e-48e1-81ef-03ff25bbcf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:20.138276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3593-6f4e-48e1-81ef-03ff25bbcf7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:20.139229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d3593-6f4e-48e1-81ef-03ff25bbcf7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:20.141206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d3593-6f4e-48e1-81ef-03ff25bbcf7a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:20.214457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9ddb7-8bbc-4f27-be71-b39240f9458a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:20.243307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 460/916] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:20:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:20:20.272293 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532d232-22f3-4606-b6fc-9ca273b3b752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:20.273070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532d232-22f3-4606-b6fc-9ca273b3b752 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:20.273406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532d232-22f3-4606-b6fc-9ca273b3b752 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:20.273686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532d232-22f3-4606-b6fc-9ca273b3b752 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:20.274565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532d232-22f3-4606-b6fc-9ca273b3b752 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:20.274945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532d232-22f3-4606-b6fc-9ca273b3b752 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:20.276561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532d232-22f3-4606-b6fc-9ca273b3b752 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:20.291693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 457/917] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:20.297814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3593-6f4e-48e1-81ef-03ff25bbcf7a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:20.412512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3593-6f4e-48e1-81ef-03ff25bbcf7a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:20.448995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:20.449707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:20.449996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:20.450276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:20.451153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] RBAC: Adding query filter params (role.id=0c53d598efad4cf5a9f3225702321c51, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=86cf6adf3f29481793c254c056ddcadd) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:20.451523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:20.452928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:20.454640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934a39-86bb-4b1b-9b89-9ff43ab59e61 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:20.454936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934a39-86bb-4b1b-9b89-9ff43ab59e61 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:20.455217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934a39-86bb-4b1b-9b89-9ff43ab59e61 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:20.456578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 458/918] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:20.459094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 461/919] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:20 2022] GET /identity/v3/role_assignments?user.id=86cf6adf3f29481793c254c056ddcadd&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=0c53d598efad4cf5a9f3225702321c51 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:20.461786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c5a9c-00df-4463-993d-ecc8e3297d05 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:20.462086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c5a9c-00df-4463-993d-ecc8e3297d05 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:20.462373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c5a9c-00df-4463-993d-ecc8e3297d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:20.482331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9d0c5a9c-00df-4463-993d-ecc8e3297d05 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:20.484025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9d0c5a9c-00df-4463-993d-ecc8e3297d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:20.560484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 459/920] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:20.582981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:20.689159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946297b-de85-4f8d-a7bf-3c495badd865 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:20.725245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:20.726064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:20.726355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:20.726668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:20.727337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:20.728726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:20.741162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 16:20:20.742710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 462/921] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:20.748919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c5a9c-00df-4463-993d-ecc8e3297d05 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:20.850207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c5a9c-00df-4463-993d-ecc8e3297d05 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:20.884064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:20.884760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:20.885041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:20.885317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:20.886041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:20.886344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:20.888353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:20.894243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 460/922] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:20.899992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:21.003304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bdebc-18f3-4c15-8222-24db792f9eef None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:21.037986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f7368-0c97-49e7-9b3c-8273d80a400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:21.038698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7368-0c97-49e7-9b3c-8273d80a400c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.038990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7368-0c97-49e7-9b3c-8273d80a400c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.039274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f7368-0c97-49e7-9b3c-8273d80a400c None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.039999 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f7368-0c97-49e7-9b3c-8273d80a400c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:21.040316 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f7368-0c97-49e7-9b3c-8273d80a400c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:21.041702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f7368-0c97-49e7-9b3c-8273d80a400c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:21.047324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 463/923] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:21.055637 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:21.082478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9e5b-b50b-4186-bc98-57d2b3685d5f None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.083140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9e5b-b50b-4186-bc98-57d2b3685d5f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.083641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce9e5b-b50b-4186-bc98-57d2b3685d5f None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.085429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 464/924] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:21.090953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3d1a-53eb-4eec-99c8-04f89199e68e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.091463 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3d1a-53eb-4eec-99c8-04f89199e68e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.091957 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3d1a-53eb-4eec-99c8-04f89199e68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.108480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-fc5a3d1a-53eb-4eec-99c8-04f89199e68e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:21.110823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fc5a3d1a-53eb-4eec-99c8-04f89199e68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:21.158966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a34cb-1941-4cf7-bda2-c38f29c84eac None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:21.197437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 465/925] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:21.197633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:21.198249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.206753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.206753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.206753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] RBAC: Adding query filter params (interface=public, service_id=f9b5b9403a964cd78e82f7d0aa675ba8, region_id=RegionOne) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:21.206753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:21.206753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:21.213605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 461/926] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Apr 28 16:20:21 2022] GET /identity/v3/endpoints?service_id=f9b5b9403a964cd78e82f7d0aa675ba8&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:21.219352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a3d1a-53eb-4eec-99c8-04f89199e68e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:21.220513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:21.323874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05b562-ddcc-4210-8c2e-1f9c9cf6f8bb None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:21.345774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a3d1a-53eb-4eec-99c8-04f89199e68e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:21.361768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504114-4949-413c-998a-26919b7e2993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:21.362772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504114-4949-413c-998a-26919b7e2993 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.363429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504114-4949-413c-998a-26919b7e2993 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.363710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504114-4949-413c-998a-26919b7e2993 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.364659 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65504114-4949-413c-998a-26919b7e2993 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:21.366474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65504114-4949-413c-998a-26919b7e2993 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:21.381629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-65504114-4949-413c-998a-26919b7e2993 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 28 16:20:21.383367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 462/927] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Apr 28 16:20:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:21.389259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35922bf8-ffcf-4d9e-aae7-e1753952ed4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:21.389931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35922bf8-ffcf-4d9e-aae7-e1753952ed4c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.390215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35922bf8-ffcf-4d9e-aae7-e1753952ed4c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.390490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35922bf8-ffcf-4d9e-aae7-e1753952ed4c None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.391209 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35922bf8-ffcf-4d9e-aae7-e1753952ed4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:21.392586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35922bf8-ffcf-4d9e-aae7-e1753952ed4c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:21.394330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504114-4949-413c-998a-26919b7e2993 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:21.401180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 466/928] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:20:21 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:20:21.509403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504114-4949-413c-998a-26919b7e2993 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:21.546241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:21.546965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.547254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.547531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.548269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:21.548576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:21.549990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:21.556096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 463/929] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:21.562351 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35922bf8-ffcf-4d9e-aae7-e1753952ed4c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:21.672901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35922bf8-ffcf-4d9e-aae7-e1753952ed4c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:21.708205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e212c-1ed4-43ae-b0a7-64b73df64218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:21.709200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e212c-1ed4-43ae-b0a7-64b73df64218 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.709695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e212c-1ed4-43ae-b0a7-64b73df64218 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.710168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e212c-1ed4-43ae-b0a7-64b73df64218 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.711110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e212c-1ed4-43ae-b0a7-64b73df64218 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:21.711614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e212c-1ed4-43ae-b0a7-64b73df64218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:21.714253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e212c-1ed4-43ae-b0a7-64b73df64218 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:21.719787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 467/930] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:21.725480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:21.827298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db08f8-fcd5-48cc-8a69-8761fab0ec0f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:21.863286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79fb2a-6699-49b4-8ba3-ce377791ba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:21.863954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79fb2a-6699-49b4-8ba3-ce377791ba28 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:21.864238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79fb2a-6699-49b4-8ba3-ce377791ba28 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:21.864513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79fb2a-6699-49b4-8ba3-ce377791ba28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:21.865269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79fb2a-6699-49b4-8ba3-ce377791ba28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:21.866663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79fb2a-6699-49b4-8ba3-ce377791ba28 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:21.966675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 464/931] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:20:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:22.661156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc71dc-509b-4c61-829a-336fc8db8cf8 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:22.662168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc71dc-509b-4c61-829a-336fc8db8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:22.662701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc71dc-509b-4c61-829a-336fc8db8cf8 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:22.664527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 468/932] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:22.669649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183b23-9cb8-408c-8fd9-07f302700733 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:22.669944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183b23-9cb8-408c-8fd9-07f302700733 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:22.670233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183b23-9cb8-408c-8fd9-07f302700733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:22.688080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-85183b23-9cb8-408c-8fd9-07f302700733 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:22.689286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-85183b23-9cb8-408c-8fd9-07f302700733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:22.765562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 465/933] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:22.785733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ee206-5190-48da-9450-e338ea7f9cab None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:22.786019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ee206-5190-48da-9450-e338ea7f9cab None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:22.786310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ee206-5190-48da-9450-e338ea7f9cab None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:22.787803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 469/934] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:22.788830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85183b23-9cb8-408c-8fd9-07f302700733 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:22.793278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096cf8b-54e6-4455-9628-ac448b33f288 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:22.793573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096cf8b-54e6-4455-9628-ac448b33f288 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:22.793860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096cf8b-54e6-4455-9628-ac448b33f288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:22.812229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-9096cf8b-54e6-4455-9628-ac448b33f288 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:22.813431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-9096cf8b-54e6-4455-9628-ac448b33f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:22.882096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 470/935] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:22.890571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85183b23-9cb8-408c-8fd9-07f302700733 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:22.905076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096cf8b-54e6-4455-9628-ac448b33f288 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:22.926065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:22.926669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:22.927207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:22.927492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:22.928219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:22.929651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:22.931372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.common [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 28 16:20:22.985746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.sql.core [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 28 16:20:22.985746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 28 16:20:22.985746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [parameters: {'id': 'dfc75a88d8204b86b32c8239a8eeca75', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 28 16:20:22.985746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80048) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 28 16:20:23.007253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dfc75a88d8204b86b32c8239a8eeca75.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dfc75a88d8204b86b32c8239a8eeca75. Apr 28 16:20:23.010097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 466/936] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Apr 28 16:20:22 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:23.016539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:23.020014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096cf8b-54e6-4455-9628-ac448b33f288 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.081332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c1a84-3342-4aaf-8f70-481fe3f0d724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.082238 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1a84-3342-4aaf-8f70-481fe3f0d724 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.082526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1a84-3342-4aaf-8f70-481fe3f0d724 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.082881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c1a84-3342-4aaf-8f70-481fe3f0d724 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.095694 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c1a84-3342-4aaf-8f70-481fe3f0d724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:23.106153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-a84c1a84-3342-4aaf-8f70-481fe3f0d724 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 16:20:23.112386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 471/937] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Apr 28 16:20:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:23.113774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c1a84-3342-4aaf-8f70-481fe3f0d724 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:23.174283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf875f93-e677-4d96-8d52-3572d4c8894e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.221061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.221850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c1a84-3342-4aaf-8f70-481fe3f0d724 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.222424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.222936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.223577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.232524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:23.234974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:23.253428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:23.259680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.259680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.259680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.259680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.260211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:23.260211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:23.260211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:23.260911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 467/938] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:23.262871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:23.273479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 472/939] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Apr 28 16:20:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:23.274808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:23.376260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2031-c0da-4e79-a812-c4f86d23d0da None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.391275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29c4e7-738f-4b1d-abf8-c7627a142e11 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.413677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.414717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.415014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.415272 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.425986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:23.427741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:23.438005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.438982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.439487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.439967 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.440932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:23.441453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:23.443101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:23.444807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:23.446566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 473/940] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:23.452281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:23.472676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 468/941] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:23.571714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2760-fc9c-4b4b-8a8c-3ca12d9688f2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.608323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fe9b-ee36-4078-8659-d521ba1e0d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.609010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fe9b-ee36-4078-8659-d521ba1e0d61 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.609295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fe9b-ee36-4078-8659-d521ba1e0d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.609579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fe9b-ee36-4078-8659-d521ba1e0d61 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.610318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fe9b-ee36-4078-8659-d521ba1e0d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:23.610660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fe9b-ee36-4078-8659-d521ba1e0d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:23.612070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fe9b-ee36-4078-8659-d521ba1e0d61 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:23.626912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 474/942] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:23.632462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:23.705169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79722-45aa-4d66-bc7a-67804c90d9fe None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.705664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79722-45aa-4d66-bc7a-67804c90d9fe None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.705780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79722-45aa-4d66-bc7a-67804c90d9fe None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.707274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 475/943] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:23.713053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff60f-dbed-4f21-8c07-4960aaa87951 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.713614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff60f-dbed-4f21-8c07-4960aaa87951 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.714095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff60f-dbed-4f21-8c07-4960aaa87951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.733738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-83aff60f-dbed-4f21-8c07-4960aaa87951 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:23.734935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-83aff60f-dbed-4f21-8c07-4960aaa87951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:23.746727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219314f-c56a-48b6-87da-fb6db7dc859b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.783334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.784162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.784451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.784732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.792433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:23.793991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:23.805833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 476/944] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:23.809690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 16:20:23.811320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 469/945] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:20:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:23.816832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aff60f-dbed-4f21-8c07-4960aaa87951 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:23.831480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:23.949903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aff60f-dbed-4f21-8c07-4960aaa87951 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.956393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bfaf8-0be7-4e4d-b2c0-dc4e36f8bada None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:23.987755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.988816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.989304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.989781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.990967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:23.991493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:23.993139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:23.993245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:23.994018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:23.994309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:23.994611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:23.995282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:23.997198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.008676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 16:20:24.010573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 470/946] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:24.016140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.018450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 477/947] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Apr 28 16:20:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:24.024456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.144602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f08b24-75e8-4bc7-aba4-a624f8c4bdc5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.148149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b1342-6f09-49ac-b775-3d36089a69f5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.179385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.180441 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.180768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.181153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.189825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.191107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.191562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.192267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.192963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.193285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:24.193750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.194777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.195631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.205940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 471/948] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:24.206603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.219749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:24.221931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 478/949] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:24.227196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.318722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2c8e-c7e0-45d3-8700-19e69969daef None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.338546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2986f7-e9f7-47e3-8880-e54c07e8c7d6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.351720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fa411-456e-415a-8f80-4cc0a20b3aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.352384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa411-456e-415a-8f80-4cc0a20b3aed None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.352667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa411-456e-415a-8f80-4cc0a20b3aed None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.352943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa411-456e-415a-8f80-4cc0a20b3aed None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.353652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fa411-456e-415a-8f80-4cc0a20b3aed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:24.353957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fa411-456e-415a-8f80-4cc0a20b3aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.355972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7fa411-456e-415a-8f80-4cc0a20b3aed None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.365467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 472/950] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:24.365467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3eb1d-8b57-471b-8099-68c6e0163cc0 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.365467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3eb1d-8b57-471b-8099-68c6e0163cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.365467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3eb1d-8b57-471b-8099-68c6e0163cc0 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.365467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 473/951] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:24.368502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3eb1d-8b57-471b-8099-68c6e0163cc0 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.377719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f3376-c9f8-4e16-a35d-dac0aba091fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.378390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3376-c9f8-4e16-a35d-dac0aba091fa None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.378714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3376-c9f8-4e16-a35d-dac0aba091fa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.379001 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3376-c9f8-4e16-a35d-dac0aba091fa None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.379738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f3376-c9f8-4e16-a35d-dac0aba091fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:24.380049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f3376-c9f8-4e16-a35d-dac0aba091fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.381430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f3376-c9f8-4e16-a35d-dac0aba091fa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.393608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 479/952] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:24.395990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c68c6-c8ae-4622-b88d-e98d8435313b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.396291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c68c6-c8ae-4622-b88d-e98d8435313b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.396578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c68c6-c8ae-4622-b88d-e98d8435313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.414085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1c0c68c6-c8ae-4622-b88d-e98d8435313b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:24.415653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1c0c68c6-c8ae-4622-b88d-e98d8435313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:24.472366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3eb1d-8b57-471b-8099-68c6e0163cc0 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.481314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 480/953] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:24.482154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c68c6-c8ae-4622-b88d-e98d8435313b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.518867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507321d-f95a-4e01-a1b7-48647b2e2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.519529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507321d-f95a-4e01-a1b7-48647b2e2c56 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.519816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507321d-f95a-4e01-a1b7-48647b2e2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.520097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507321d-f95a-4e01-a1b7-48647b2e2c56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.520843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507321d-f95a-4e01-a1b7-48647b2e2c56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.522207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507321d-f95a-4e01-a1b7-48647b2e2c56 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.584339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c68c6-c8ae-4622-b88d-e98d8435313b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.589373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 474/954] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:20:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:24.590001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507321d-f95a-4e01-a1b7-48647b2e2c56 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.648568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.649710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.650602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.651076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.661788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.664562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.682949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:24.689300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 481/955] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:24.690271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.725998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507321d-f95a-4e01-a1b7-48647b2e2c56 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.763044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.764225 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.764705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.765159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.766011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.767627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.780267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 28 16:20:24.786960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 475/956] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:24.788383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.800864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd5d38-61d3-471e-b1c5-77e75efd12ac None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.836723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.837615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.837905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.838186 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.839325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:24.839325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.841382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.853579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 482/957] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:24.859482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.891464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c57c-715f-4310-b3fd-a1b8c783f9ec None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:24.928599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:24.929270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:24.929554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:24.929835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:24.930571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:24.930896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:24.932261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:24.937818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 476/958] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:24.943673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:24.968080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683297f3-4c9b-4da9-9b2b-03ff93988b5f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:25.002511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12800f3-4497-46bc-a7e8-7331174fdd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:25.003519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12800f3-4497-46bc-a7e8-7331174fdd4c None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:25.003812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12800f3-4497-46bc-a7e8-7331174fdd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:25.004091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12800f3-4497-46bc-a7e8-7331174fdd4c None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/86cf6adf3f29481793c254c056ddcadd/roles/0c53d598efad4cf5a9f3225702321c51` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:25.006485 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12800f3-4497-46bc-a7e8-7331174fdd4c None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=86cf6adf3f29481793c254c056ddcadd, role_id=0c53d598efad4cf5a9f3225702321c51)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:25.007983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12800f3-4497-46bc-a7e8-7331174fdd4c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:25.063848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0853ad-c935-409e-80c0-f9ad2f520851 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:25.069836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 483/959] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:20:24 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/86cf6adf3f29481793c254c056ddcadd/roles/0c53d598efad4cf5a9f3225702321c51 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:20:25.102430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13dd03-bfa4-4a31-83d2-ea958541eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:25.103072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13dd03-bfa4-4a31-83d2-ea958541eaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:25.103359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13dd03-bfa4-4a31-83d2-ea958541eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:25.103639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13dd03-bfa4-4a31-83d2-ea958541eaa9 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:25.104377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13dd03-bfa4-4a31-83d2-ea958541eaa9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:25.104684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13dd03-bfa4-4a31-83d2-ea958541eaa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:25.106135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13dd03-bfa4-4a31-83d2-ea958541eaa9 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:25.111817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 477/960] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:25.862524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d013-0a5a-42cd-ab26-9c63589a8599 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:25.863058 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d013-0a5a-42cd-ab26-9c63589a8599 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:25.863131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d013-0a5a-42cd-ab26-9c63589a8599 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:25.864864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 484/961] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:25.870334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db75a7-298d-42fd-858f-bf1308dceaa5 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:25.870726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db75a7-298d-42fd-858f-bf1308dceaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:25.871104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db75a7-298d-42fd-858f-bf1308dceaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:25.888011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-24db75a7-298d-42fd-858f-bf1308dceaa5 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:25.889531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-24db75a7-298d-42fd-858f-bf1308dceaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:25.956937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 478/962] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:25.981767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614d013-0a5a-42cd-ab26-9c63589a8599 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:26.085294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614d013-0a5a-42cd-ab26-9c63589a8599 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:26.119554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:26.120153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:26.120437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:26.120713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:26.122044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:26.123520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:26.124825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.common [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 28 16:20:26.181574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.sql.core [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 28 16:20:26.181574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 28 16:20:26.181574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [parameters: {'user_id': '88f2ec4ab33445ed8cd0b2ef7357a937', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 28 16:20:26.181574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80049) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 28 16:20:26.188506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 28 16:20:26.190211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 485/963] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Apr 28 16:20:25 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:26.196226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db75a7-298d-42fd-858f-bf1308dceaa5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:26.302372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db75a7-298d-42fd-858f-bf1308dceaa5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:26.336881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff04fab-d752-49c2-902c-643771cf376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:26.337682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04fab-d752-49c2-902c-643771cf376e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:26.337962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04fab-d752-49c2-902c-643771cf376e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:26.338237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04fab-d752-49c2-902c-643771cf376e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:26.346079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff04fab-d752-49c2-902c-643771cf376e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:26.347534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff04fab-d752-49c2-902c-643771cf376e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:26.361172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-aff04fab-d752-49c2-902c-643771cf376e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 28 16:20:26.366759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 479/964] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:20:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:26.368676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:26.470365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa862e-6d2e-4dde-b294-c60d0e83cc76 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:26.503554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f99a26-fd28-40ba-9bf5-84a4a0670df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:26.504233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f99a26-fd28-40ba-9bf5-84a4a0670df0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:26.504562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f99a26-fd28-40ba-9bf5-84a4a0670df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:26.504842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f99a26-fd28-40ba-9bf5-84a4a0670df0 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:26.505652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f99a26-fd28-40ba-9bf5-84a4a0670df0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:26.505955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f99a26-fd28-40ba-9bf5-84a4a0670df0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:26.507624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f99a26-fd28-40ba-9bf5-84a4a0670df0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:26.546165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 486/965] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Apr 28 16:20:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:26.955180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859634b0-a9a6-4b14-9216-a7395b9d3264 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:26.955550 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859634b0-a9a6-4b14-9216-a7395b9d3264 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:26.955767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859634b0-a9a6-4b14-9216-a7395b9d3264 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:26.957247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 480/966] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:26.962360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614048de-f7ad-49bf-bfa8-7358647f280b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:26.962852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614048de-f7ad-49bf-bfa8-7358647f280b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:26.963009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614048de-f7ad-49bf-bfa8-7358647f280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:26.979696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-614048de-f7ad-49bf-bfa8-7358647f280b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:26.981743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-614048de-f7ad-49bf-bfa8-7358647f280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:27.055151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 487/967] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:27.077863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859634b0-a9a6-4b14-9216-a7395b9d3264 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.173831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859634b0-a9a6-4b14-9216-a7395b9d3264 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:27.207401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:27.208162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.208447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.208721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.209399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:27.210859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:27.223908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 16:20:27.225524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 481/968] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:27.232314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614048de-f7ad-49bf-bfa8-7358647f280b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.331635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614048de-f7ad-49bf-bfa8-7358647f280b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:27.364537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4b23d-a6db-4d09-b01b-6c61ad0b415a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:27.365204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b23d-a6db-4d09-b01b-6c61ad0b415a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.365487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b23d-a6db-4d09-b01b-6c61ad0b415a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.365759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b23d-a6db-4d09-b01b-6c61ad0b415a None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.366460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4b23d-a6db-4d09-b01b-6c61ad0b415a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:27.366794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4b23d-a6db-4d09-b01b-6c61ad0b415a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:27.368157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4b23d-a6db-4d09-b01b-6c61ad0b415a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:27.377453 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 488/969] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:27.378698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.398901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfbf25-8437-4daf-8a02-d2e6d19aaf22 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.399192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfbf25-8437-4daf-8a02-d2e6d19aaf22 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.399477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfbf25-8437-4daf-8a02-d2e6d19aaf22 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.400976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 489/970] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:27.406180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7499276-5a1c-4fd5-b104-b7547f790c34 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.406463 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7499276-5a1c-4fd5-b104-b7547f790c34 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.406764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7499276-5a1c-4fd5-b104-b7547f790c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.423440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c7499276-5a1c-4fd5-b104-b7547f790c34 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:27.424623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c7499276-5a1c-4fd5-b104-b7547f790c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:27.475585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b4ece-cd0f-4a37-958a-23bcfb10e0d7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:27.487445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 490/971] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:27.488747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95604e57-cf54-42e5-b398-ca30b804386c None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.489031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95604e57-cf54-42e5-b398-ca30b804386c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.489310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95604e57-cf54-42e5-b398-ca30b804386c None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.490574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 491/972] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:27.495969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05e0f-9d06-4291-bee8-adef341eebd7 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.496344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05e0f-9d06-4291-bee8-adef341eebd7 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.496690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05e0f-9d06-4291-bee8-adef341eebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.508412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:27.509088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.509452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.509732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.510445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:27.510784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:27.512189 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:27.513185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-52a05e0f-9d06-4291-bee8-adef341eebd7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:27.514396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-52a05e0f-9d06-4291-bee8-adef341eebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:27.517006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 482/973] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:27.517833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.580235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 492/974] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:27.581091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a05e0f-9d06-4291-bee8-adef341eebd7 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.624956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ff69-ff77-4a91-9bae-8c76143fbf7c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:27.657525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce1322-2994-4795-985d-edb8e324c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:27.658337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce1322-2994-4795-985d-edb8e324c44d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.658656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce1322-2994-4795-985d-edb8e324c44d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.658936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce1322-2994-4795-985d-edb8e324c44d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.668522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce1322-2994-4795-985d-edb8e324c44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:27.675617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a05e0f-9d06-4291-bee8-adef341eebd7 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:27.676006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-42ce1322-2994-4795-985d-edb8e324c44d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 16:20:27.677450 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 483/975] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Apr 28 16:20:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:27.678199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce1322-2994-4795-985d-edb8e324c44d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.710079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:27.710766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.711055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.711330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.712128 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] RBAC: Adding query filter params (interface=admin, service_id=f9b5b9403a964cd78e82f7d0aa675ba8, region_id=RegionOne) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:27.712440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:27.713817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:27.719208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 493/976] 10.222.0.43 () {56 vars in 1249 bytes} [Thu Apr 28 16:20:27 2022] GET /identity/v3/endpoints?service_id=f9b5b9403a964cd78e82f7d0aa675ba8&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:27.719971 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.780544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce1322-2994-4795-985d-edb8e324c44d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:27.822727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dbaa4-220c-4c99-ac20-7b34273a9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:27.823391 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dbaa4-220c-4c99-ac20-7b34273a9ffc None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.823673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dbaa4-220c-4c99-ac20-7b34273a9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.824473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dbaa4-220c-4c99-ac20-7b34273a9ffc None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.825193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dbaa4-220c-4c99-ac20-7b34273a9ffc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:27.826561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dbaa4-220c-4c99-ac20-7b34273a9ffc None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:27.828703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486bf5e-c5a0-4446-87d4-e69165ad6293 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:27.861342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:27.862008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:27.862277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:27.862572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:27.863318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:27.863628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:27.865075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:27.872807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 494/977] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Apr 28 16:20:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:27.873560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.938572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 484/978] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:20:27 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:27.938572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dbaa4-220c-4c99-ac20-7b34273a9ffc None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:27.972169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d2816-235c-434a-ac14-5521782bb32b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:28.015812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7711f-aedd-4bec-92ab-31f73926910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:28.016505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7711f-aedd-4bec-92ab-31f73926910d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:28.016789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7711f-aedd-4bec-92ab-31f73926910d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:28.017064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7711f-aedd-4bec-92ab-31f73926910d None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:28.017766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7711f-aedd-4bec-92ab-31f73926910d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:28.019201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7711f-aedd-4bec-92ab-31f73926910d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:28.024538 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dbaa4-220c-4c99-ac20-7b34273a9ffc None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:28.034912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 495/979] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:20:27 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:20:28.063587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058f378-3803-4470-92cd-26aadec749de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:28.064424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f378-3803-4470-92cd-26aadec749de None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:28.064711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f378-3803-4470-92cd-26aadec749de None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:28.064992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f378-3803-4470-92cd-26aadec749de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:28.078118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058f378-3803-4470-92cd-26aadec749de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:28.079717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058f378-3803-4470-92cd-26aadec749de None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:28.097666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-9058f378-3803-4470-92cd-26aadec749de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:28.099197 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 485/980] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:28.105152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7711f-aedd-4bec-92ab-31f73926910d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:28.213875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7711f-aedd-4bec-92ab-31f73926910d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:28.248510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:28.249185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:28.249497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:28.249829 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:28.250476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:28.250819 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:28.252201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:28.265170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 496/981] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:28.270995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058f378-3803-4470-92cd-26aadec749de None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:28.366673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058f378-3803-4470-92cd-26aadec749de None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:28.398071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:28.398909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:28.399192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:28.399465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:28.406589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:28.408040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:28.421795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 28 16:20:28.423168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 486/982] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:20:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:28.428836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:28.522277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d767fb-5a99-4278-8a5c-7bdb0c937d24 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:28.554478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:28.555226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:28.555515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:28.555792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:28.556630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:28.556942 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:28.558995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:28.579570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 497/983] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Apr 28 16:20:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:28.581007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:28.673998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fa60d-edff-4c33-8102-523645a3fb0e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:28.705743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b0e27-1197-47c9-afbb-fec0506dedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:28.706393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b0e27-1197-47c9-afbb-fec0506dedbd None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:28.706709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b0e27-1197-47c9-afbb-fec0506dedbd None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:28.706986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b0e27-1197-47c9-afbb-fec0506dedbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:28.771649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b0e27-1197-47c9-afbb-fec0506dedbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:28.773105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b0e27-1197-47c9-afbb-fec0506dedbd None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:28.869506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 487/984] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:28 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 28 16:20:28.875508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:28.970258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea84e6-f6b1-4942-aa5b-9aa71a6678ca None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:29.001781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:29.002595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:29.002880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:29.003154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:29.013919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:29.015388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:29.031399 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:29.032769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 498/985] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:29.041303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b0e27-1197-47c9-afbb-fec0506dedbd None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:29.137389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b0e27-1197-47c9-afbb-fec0506dedbd None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:29.170622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:29.171292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:29.171574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:29.171849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:29.172569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:29.172871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:29.174227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:29.186152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 488/986] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:29.191440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:29.284698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb78686-1a60-4922-a9fe-e7362ea1b92b None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:29.317078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:29.317884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:29.318162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:29.318436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:29.325016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:29.326457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:29.339748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:29.341067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 499/987] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:29.346476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:29.442477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322af5f-ff55-45ac-83c2-060c0e6c0332 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:29.476057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ecdf9-1c55-42c7-9145-9528637f3914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:29.476726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ecdf9-1c55-42c7-9145-9528637f3914 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:29.477012 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ecdf9-1c55-42c7-9145-9528637f3914 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:29.477285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ecdf9-1c55-42c7-9145-9528637f3914 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:29.478071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ecdf9-1c55-42c7-9145-9528637f3914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:29.478379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ecdf9-1c55-42c7-9145-9528637f3914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:29.479887 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ecdf9-1c55-42c7-9145-9528637f3914 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:29.497019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 489/988] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:29.498589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:29.594016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97904de-dc48-4ffe-acfd-8c142d30092a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:29.627289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fce40-f9a6-4b80-9da0-ae595b4ba422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:29.627955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fce40-f9a6-4b80-9da0-ae595b4ba422 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:29.628241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fce40-f9a6-4b80-9da0-ae595b4ba422 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:29.628527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fce40-f9a6-4b80-9da0-ae595b4ba422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:29.629368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fce40-f9a6-4b80-9da0-ae595b4ba422 None admin] RBAC: Adding query filter params (role.id=0c53d598efad4cf5a9f3225702321c51, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=86cf6adf3f29481793c254c056ddcadd) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:29.629685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fce40-f9a6-4b80-9da0-ae595b4ba422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:29.631174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fce40-f9a6-4b80-9da0-ae595b4ba422 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:29.637375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 500/989] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:29 2022] GET /identity/v3/role_assignments?user.id=86cf6adf3f29481793c254c056ddcadd&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=0c53d598efad4cf5a9f3225702321c51 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:30.217252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ba08-3f80-4fdd-ba7a-7386506795ae None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.217603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ba08-3f80-4fdd-ba7a-7386506795ae None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.217828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2ba08-3f80-4fdd-ba7a-7386506795ae None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.219406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 490/990] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:30.224265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41fcc-751c-4ac1-ae33-0068dea0a180 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.224690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41fcc-751c-4ac1-ae33-0068dea0a180 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.224843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41fcc-751c-4ac1-ae33-0068dea0a180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.241142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-eef41fcc-751c-4ac1-ae33-0068dea0a180 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:30.242339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-eef41fcc-751c-4ac1-ae33-0068dea0a180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:30.304462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f17d1a-5d67-46f6-b7fa-6275e290d54e None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.304676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f17d1a-5d67-46f6-b7fa-6275e290d54e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.304959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f17d1a-5d67-46f6-b7fa-6275e290d54e None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.306389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 491/991] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:30.311908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aedde-6fe0-4394-b149-74cd7a5b0189 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.312200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aedde-6fe0-4394-b149-74cd7a5b0189 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.312484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1aedde-6fe0-4394-b149-74cd7a5b0189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.339235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6c1aedde-6fe0-4394-b149-74cd7a5b0189 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:30.340453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6c1aedde-6fe0-4394-b149-74cd7a5b0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:30.366708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 501/992] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:30.381751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef41fcc-751c-4ac1-ae33-0068dea0a180 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:30.407512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 492/993] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:30.430363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aedde-6fe0-4394-b149-74cd7a5b0189 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:30.480669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef41fcc-751c-4ac1-ae33-0068dea0a180 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:30.514196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:30.515022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.515306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.515579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.516236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:30.517600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:30.525044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1aedde-6fe0-4394-b149-74cd7a5b0189 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:30.528682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 28 16:20:30.530025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 502/994] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:30.535703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:30.557845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:30.559137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.559420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.559691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.560346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:30.561706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:30.572826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 28 16:20:30.574742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 493/995] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Apr 28 16:20:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:30.580280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:30.638734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d1b37-ed5d-48bf-b667-e351a0f82bbc None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:30.673549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:30.674211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.674497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.674798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.675504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:30.675807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:30.675911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c10669-2f90-4fa7-b689-3097bfee3194 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:30.677452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:30.690586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 503/996] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:30.691446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:30.709632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:30.710347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.710664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.710988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.711694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:30.712001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:30.713405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:30.723774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 494/997] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:30.724396 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:30.789997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ce4d2-990a-42d9-963a-c0f0d2a1d2cb None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:30.823960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee10ab6-9e79-4ec0-8dcb-10ce916045e0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:30.826359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:30.827053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.827336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.827612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.828319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:30.828626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:30.829992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:30.839498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 504/998] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:30.840460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:30.861468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:30.862126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.862412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.862733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.863445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:30.863750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:30.865106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:30.874967 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 495/999] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Apr 28 16:20:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:30.876006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:30.937164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439ffb-9c2c-491f-946f-91d5b563a3c3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:30.970637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:30.971423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:30.971719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:30.972041 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:30.972923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] RBAC: Adding query filter params (interface=public, service_id=b5296f409fd5465dba8c281df08731b6, region_id=RegionOne) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:30.973030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ffecc-3ff0-468d-95f2-a33a8300d9f5 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:30.973283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:30.974754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:30.980804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 505/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Apr 28 16:20:30 2022] GET /identity/v3/endpoints?service_id=b5296f409fd5465dba8c281df08731b6&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:30.985932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:31.005259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70f6ad-5aca-4e79-9598-2006e8ec1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:31.005914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f6ad-5aca-4e79-9598-2006e8ec1885 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:31.006198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f6ad-5aca-4e79-9598-2006e8ec1885 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:31.006474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f6ad-5aca-4e79-9598-2006e8ec1885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:31.007255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70f6ad-5aca-4e79-9598-2006e8ec1885 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:31.008581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70f6ad-5aca-4e79-9598-2006e8ec1885 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:31.082630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19cbd7-9a80-46a0-a819-7dac204e8357 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:31.094566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 496/1001] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:20:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:31.127606 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dc7bf-d2bb-4dac-9581-cefe8f968fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:31.128290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc7bf-d2bb-4dac-9581-cefe8f968fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:31.128576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc7bf-d2bb-4dac-9581-cefe8f968fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:31.128869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc7bf-d2bb-4dac-9581-cefe8f968fb6 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:31.129609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dc7bf-d2bb-4dac-9581-cefe8f968fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:31.131034 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dc7bf-d2bb-4dac-9581-cefe8f968fb6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:31.146893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 506/1002] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:20:30 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:20:31.913471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304204da-29c5-44af-9abe-916b684e8b09 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:31.913991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304204da-29c5-44af-9abe-916b684e8b09 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:31.914065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304204da-29c5-44af-9abe-916b684e8b09 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:31.915470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 497/1003] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:31.921159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d783fa-c3fe-4f25-ad66-5d48d4148f6d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:31.921597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d783fa-c3fe-4f25-ad66-5d48d4148f6d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:31.921788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d783fa-c3fe-4f25-ad66-5d48d4148f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:31.938576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-41d783fa-c3fe-4f25-ad66-5d48d4148f6d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:31.939769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-41d783fa-c3fe-4f25-ad66-5d48d4148f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:32.004565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 507/1004] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:32.026511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304204da-29c5-44af-9abe-916b684e8b09 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:32.129735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304204da-29c5-44af-9abe-916b684e8b09 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:32.162160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:32.162990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:32.163277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:32.163599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] PATH_INFO: `/v3/services/image` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:32.164208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:32.165574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:32.176359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 28 16:20:32.182807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 498/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Apr 28 16:20:32 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:32.183872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d783fa-c3fe-4f25-ad66-5d48d4148f6d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:32.285888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d783fa-c3fe-4f25-ad66-5d48d4148f6d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:32.319880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7c253-bc70-4139-aff8-33439eac553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:32.320550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c253-bc70-4139-aff8-33439eac553b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:32.320832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c253-bc70-4139-aff8-33439eac553b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:32.321108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7c253-bc70-4139-aff8-33439eac553b None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:32.322052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7c253-bc70-4139-aff8-33439eac553b None admin] RBAC: Adding query filter params (name=image) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:32.322364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7c253-bc70-4139-aff8-33439eac553b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:32.324260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7c253-bc70-4139-aff8-33439eac553b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:32.329092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 508/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:32.334559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:32.428107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c185e2-55a9-4e6b-8c84-5a6c3ec7d525 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:32.460127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2ebde-cd41-433c-bfee-453335708cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:32.461034 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2ebde-cd41-433c-bfee-453335708cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:32.461520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2ebde-cd41-433c-bfee-453335708cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:32.461995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2ebde-cd41-433c-bfee-453335708cf8 None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:32.462937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2ebde-cd41-433c-bfee-453335708cf8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:32.463446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2ebde-cd41-433c-bfee-453335708cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:32.465044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2ebde-cd41-433c-bfee-453335708cf8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:32.469782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 499/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:33.424854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7692-d3b9-4914-889b-dc9ac3bd68c1 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:33.425372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7692-d3b9-4914-889b-dc9ac3bd68c1 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:33.425479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e7692-d3b9-4914-889b-dc9ac3bd68c1 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:33.427224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 509/1008] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:33.432480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba091-55a9-41c7-831f-150512cfea85 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:33.432883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba091-55a9-41c7-831f-150512cfea85 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:33.433043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ba091-55a9-41c7-831f-150512cfea85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:33.440288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783c21-eae3-457c-9968-ccc817450a67 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:33.440578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783c21-eae3-457c-9968-ccc817450a67 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:33.440859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783c21-eae3-457c-9968-ccc817450a67 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:33.442326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 510/1009] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:33.446949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ca342-fd1a-4006-af74-2c6bed734c8a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:33.447240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ca342-fd1a-4006-af74-2c6bed734c8a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:33.447518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ca342-fd1a-4006-af74-2c6bed734c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:33.450199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-187ba091-55a9-41c7-831f-150512cfea85 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:33.451434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-187ba091-55a9-41c7-831f-150512cfea85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:33.463786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-db9ca342-fd1a-4006-af74-2c6bed734c8a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:33.465751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-db9ca342-fd1a-4006-af74-2c6bed734c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:33.518549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 500/1010] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:33.532188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 511/1011] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:33.541805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ba091-55a9-41c7-831f-150512cfea85 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:33.559130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ca342-fd1a-4006-af74-2c6bed734c8a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:33.644627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ba091-55a9-41c7-831f-150512cfea85 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:33.659716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ca342-fd1a-4006-af74-2c6bed734c8a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:33.680966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:33.681700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:33.681986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:33.682264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:33.682953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:33.684348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:33.693473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14780b05-538e-451a-9a08-7f0e287949e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:33.694268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14780b05-538e-451a-9a08-7f0e287949e7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:33.694578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14780b05-538e-451a-9a08-7f0e287949e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:33.694864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14780b05-538e-451a-9a08-7f0e287949e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:33.695052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 28 16:20:33.696071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14780b05-538e-451a-9a08-7f0e287949e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:33.704491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 501/1012] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:33.704638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14780b05-538e-451a-9a08-7f0e287949e7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:33.704638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 512/1013] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:33.705470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:33.707234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14780b05-538e-451a-9a08-7f0e287949e7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:33.814142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14780b05-538e-451a-9a08-7f0e287949e7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:33.821768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec674c03-1a48-4cf8-8b16-c5f274270c50 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:33.848475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28464051-dd98-4ed2-824e-ce06110f7d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:33.849146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464051-dd98-4ed2-824e-ce06110f7d07 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:33.849436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464051-dd98-4ed2-824e-ce06110f7d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:33.849727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464051-dd98-4ed2-824e-ce06110f7d07 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:33.850436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28464051-dd98-4ed2-824e-ce06110f7d07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:33.851916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28464051-dd98-4ed2-824e-ce06110f7d07 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:33.856818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:33.857490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:33.857782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:33.858059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:33.858800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:33.859108 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:33.860465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:33.869804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 502/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:33.870733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:33.954644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 513/1015] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:20:33 2022] POST /identity/v3/projects => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:33.980197 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2ce53-3b43-4b83-a895-83519e4fc30f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:34.015627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4b7e9-696a-42f3-aef5-b59a53ad626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:34.016318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4b7e9-696a-42f3-aef5-b59a53ad626c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:34.016610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4b7e9-696a-42f3-aef5-b59a53ad626c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:34.016885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4b7e9-696a-42f3-aef5-b59a53ad626c None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:34.017614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4b7e9-696a-42f3-aef5-b59a53ad626c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:34.017926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4b7e9-696a-42f3-aef5-b59a53ad626c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:34.019507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4b7e9-696a-42f3-aef5-b59a53ad626c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:34.025086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 503/1016] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Apr 28 16:20:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:34.031147 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28464051-dd98-4ed2-824e-ce06110f7d07 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:34.154468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28464051-dd98-4ed2-824e-ce06110f7d07 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:34.193558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf77865-b165-4c4d-a06f-25c31536573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:34.194511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf77865-b165-4c4d-a06f-25c31536573d None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:34.194867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf77865-b165-4c4d-a06f-25c31536573d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:34.195145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf77865-b165-4c4d-a06f-25c31536573d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:34.195937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf77865-b165-4c4d-a06f-25c31536573d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:34.197375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf77865-b165-4c4d-a06f-25c31536573d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:34.296535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 514/1017] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:20:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:34.726713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8695f8f-93ed-4ee8-9c84-28d2e5f7c27a None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:34.727249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8695f8f-93ed-4ee8-9c84-28d2e5f7c27a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:34.727352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8695f8f-93ed-4ee8-9c84-28d2e5f7c27a None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:34.728783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 504/1018] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:34.734386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f7e4-7b17-461a-988d-1a514da51b10 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:34.734813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f7e4-7b17-461a-988d-1a514da51b10 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:34.735008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8f7e4-7b17-461a-988d-1a514da51b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:34.751317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8dc8f7e4-7b17-461a-988d-1a514da51b10 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:34.752513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8dc8f7e4-7b17-461a-988d-1a514da51b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:34.823234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 515/1019] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:34.845858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8695f8f-93ed-4ee8-9c84-28d2e5f7c27a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:34.943062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8695f8f-93ed-4ee8-9c84-28d2e5f7c27a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:34.974555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa71f61-56f3-41d9-bc30-2f10bf71eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:34.975220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa71f61-56f3-41d9-bc30-2f10bf71eccd None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:34.975510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa71f61-56f3-41d9-bc30-2f10bf71eccd None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:34.975791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa71f61-56f3-41d9-bc30-2f10bf71eccd None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:34.976530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa71f61-56f3-41d9-bc30-2f10bf71eccd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:34.977942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa71f61-56f3-41d9-bc30-2f10bf71eccd None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:35.062559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 505/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:20:34 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:36.264914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a7a31-e5b7-4ca6-9c0b-8398c1069a30 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:36.265425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a7a31-e5b7-4ca6-9c0b-8398c1069a30 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:36.266995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a7a31-e5b7-4ca6-9c0b-8398c1069a30 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:36.266995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 516/1021] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:36.272618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fef7-070a-4937-8cf3-677eaf21e969 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:36.273045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fef7-070a-4937-8cf3-677eaf21e969 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:36.273173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fef7-070a-4937-8cf3-677eaf21e969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:36.289711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-09a6fef7-070a-4937-8cf3-677eaf21e969 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:36.290922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-09a6fef7-070a-4937-8cf3-677eaf21e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:36.359980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 506/1022] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:36.384115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a7a31-e5b7-4ca6-9c0b-8398c1069a30 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:36.489497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a7a31-e5b7-4ca6-9c0b-8398c1069a30 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:36.523371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d8f90-6360-46bd-9aac-13cfbe44cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:36.524279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8f90-6360-46bd-9aac-13cfbe44cc59 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:36.524566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8f90-6360-46bd-9aac-13cfbe44cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:36.524845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8f90-6360-46bd-9aac-13cfbe44cc59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:36.526009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8f90-6360-46bd-9aac-13cfbe44cc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:36.527503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8f90-6360-46bd-9aac-13cfbe44cc59 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:36.533846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 517/1023] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:36.535435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6fef7-070a-4937-8cf3-677eaf21e969 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:36.616947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e76bf-c841-4d19-ba3d-52c5a8270d88 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:36.617202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e76bf-c841-4d19-ba3d-52c5a8270d88 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:36.617437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e76bf-c841-4d19-ba3d-52c5a8270d88 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:36.618838 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 518/1024] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:36.624193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6d6b-465c-4e86-96df-7ec6f0f5cc78 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:36.624557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6d6b-465c-4e86-96df-7ec6f0f5cc78 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:36.625028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6d6b-465c-4e86-96df-7ec6f0f5cc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:36.630219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6fef7-070a-4937-8cf3-677eaf21e969 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:36.641455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-fecf6d6b-465c-4e86-96df-7ec6f0f5cc78 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:36.642675 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fecf6d6b-465c-4e86-96df-7ec6f0f5cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:36.662489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474906be-632d-43cf-a1b2-4f94f80e58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:36.663183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474906be-632d-43cf-a1b2-4f94f80e58a0 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:36.663474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474906be-632d-43cf-a1b2-4f94f80e58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:36.663747 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474906be-632d-43cf-a1b2-4f94f80e58a0 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:36.664452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474906be-632d-43cf-a1b2-4f94f80e58a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:36.665873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474906be-632d-43cf-a1b2-4f94f80e58a0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:36.708741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 519/1025] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:36.732376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6d6b-465c-4e86-96df-7ec6f0f5cc78 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:36.741426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 507/1026] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:20:36 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:36.837026 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6d6b-465c-4e86-96df-7ec6f0f5cc78 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:36.883290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00488cf0-12ab-4f5a-9f08-807f3f6f182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:36.884056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00488cf0-12ab-4f5a-9f08-807f3f6f182c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:36.884341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00488cf0-12ab-4f5a-9f08-807f3f6f182c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:36.884619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00488cf0-12ab-4f5a-9f08-807f3f6f182c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:36.900480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00488cf0-12ab-4f5a-9f08-807f3f6f182c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:36.908406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-00488cf0-12ab-4f5a-9f08-807f3f6f182c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 16:20:36.918070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 520/1027] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Apr 28 16:20:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:36.918250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474906be-632d-43cf-a1b2-4f94f80e58a0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.054739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474906be-632d-43cf-a1b2-4f94f80e58a0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.090603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.091283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.091568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.091851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.092602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:37.092908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.094267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:37.102571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 508/1028] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Apr 28 16:20:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:37.108782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00488cf0-12ab-4f5a-9f08-807f3f6f182c None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.215873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00488cf0-12ab-4f5a-9f08-807f3f6f182c None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.248444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aef3e2-6d11-42ab-b14d-529614a5df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.249240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef3e2-6d11-42ab-b14d-529614a5df3a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.249521 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef3e2-6d11-42ab-b14d-529614a5df3a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.249795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef3e2-6d11-42ab-b14d-529614a5df3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.260126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aef3e2-6d11-42ab-b14d-529614a5df3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.261880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aef3e2-6d11-42ab-b14d-529614a5df3a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:37.278308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-66aef3e2-6d11-42ab-b14d-529614a5df3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:37.279789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 521/1029] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:37.285181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.361598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122a07-c8d1-4af1-b784-985a7de170e2 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.361896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122a07-c8d1-4af1-b784-985a7de170e2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.362170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8122a07-c8d1-4af1-b784-985a7de170e2 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.364877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 522/1030] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:37.368283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6881-f3ab-494f-b819-506dc19e8d38 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.368579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6881-f3ab-494f-b819-506dc19e8d38 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.368858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6881-f3ab-494f-b819-506dc19e8d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.383801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9ff3f-7ac3-4886-92a3-6ca9076e4946 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.385904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-769a6881-f3ab-494f-b819-506dc19e8d38 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:37.387557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-769a6881-f3ab-494f-b819-506dc19e8d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:37.419091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.419805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.420600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.421033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.422138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:37.422619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.424961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:37.437926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 509/1031] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:37.443239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.455037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 523/1032] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:37.477619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6881-f3ab-494f-b819-506dc19e8d38 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.543307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c26d0-1f85-4ff0-9eaf-6d6e4f0cbfd8 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.575490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6881-f3ab-494f-b819-506dc19e8d38 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.577519 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.578743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.579032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.579379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.588260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.589733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:37.603471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:20:37.605362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 510/1033] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:37.610629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.613399 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.614193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.614481 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.614786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.615445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.616808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:37.628375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 28 16:20:37.629573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 524/1034] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:37.635866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.706893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2d67c-1f3d-4803-9618-d70764f5c980 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.733493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91bef2-06e8-400c-849a-66751004f8a5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.740501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.741163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.741448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.741722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.742582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:37.742894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.744313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:37.761399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 511/1035] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:37.766803 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.770464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.771160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.771449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.771724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.772438 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] RBAC: Adding query filter params (name=image) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:37.772745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.774111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:37.780521 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 525/1036] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:37.785139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.866583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e7474-7950-4ce8-945d-d8811d64c8a3 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.881205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aace02-5677-49eb-811b-991cd0101206 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:37.898615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fdd54-97e5-4ecb-96f2-1bdb8f23cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.899269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fdd54-97e5-4ecb-96f2-1bdb8f23cb4b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.899556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fdd54-97e5-4ecb-96f2-1bdb8f23cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.899832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fdd54-97e5-4ecb-96f2-1bdb8f23cb4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.914704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:37.915372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:37.915660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:37.915942 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:37.916660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] RBAC: Adding query filter params (type=image) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:37.916973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.918988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:37.929304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 526/1037] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:37.930258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:37.966919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fdd54-97e5-4ecb-96f2-1bdb8f23cb4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:37.968371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fdd54-97e5-4ecb-96f2-1bdb8f23cb4b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:38.033541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b588f-f247-45c0-99ab-ca97279f9188 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:38.068225 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 512/1038] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:38.074389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fdd54-97e5-4ecb-96f2-1bdb8f23cb4b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:38.081722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:38.082580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:38.083026 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:38.083784 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:38.085038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] RBAC: Adding query filter params (interface=public, service_id=69ccb412f9654aa4868727c3f1425ca1, region_id=RegionOne) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:38.085776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:38.087491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:38.094126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 527/1039] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Apr 28 16:20:37 2022] GET /identity/v3/endpoints?service_id=69ccb412f9654aa4868727c3f1425ca1&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:38.099461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:38.172993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fdd54-97e5-4ecb-96f2-1bdb8f23cb4b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:38.196321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf13e97-3e1e-4f24-b463-64b94142e714 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:38.205704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:38.206502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:38.206817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:38.207098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:38.217180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:38.218652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:38.230800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d26c08-73e2-4f95-a602-c612e59f45e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:38.231471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d26c08-73e2-4f95-a602-c612e59f45e6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:38.231759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d26c08-73e2-4f95-a602-c612e59f45e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:38.232041 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d26c08-73e2-4f95-a602-c612e59f45e6 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:38.232732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d26c08-73e2-4f95-a602-c612e59f45e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:38.234084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d26c08-73e2-4f95-a602-c612e59f45e6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:38.234992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:38.240854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 513/1040] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:38.241638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:38.244804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 528/1041] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:20:38 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:20:38.349252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c62c-422e-4ebc-864d-ec8365a2047d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:38.383578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:38.384267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:38.384557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:38.384839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:38.385597 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:38.385912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:38.387906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:38.405086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 514/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:38.406861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d26c08-73e2-4f95-a602-c612e59f45e6 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:38.507597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d26c08-73e2-4f95-a602-c612e59f45e6 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:38.541097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:38.541899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:38.542185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:38.542494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:38.549252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:38.550728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:38.565075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:38.570611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 529/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:38.572319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:38.668225 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cf523-6351-4bbb-b946-6efb3c091582 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:38.700847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c73ee0-641a-43c1-9172-8e7dc006c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:38.701505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73ee0-641a-43c1-9172-8e7dc006c70b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:38.701794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73ee0-641a-43c1-9172-8e7dc006c70b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:38.702073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73ee0-641a-43c1-9172-8e7dc006c70b None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:38.702897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c73ee0-641a-43c1-9172-8e7dc006c70b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:38.703214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c73ee0-641a-43c1-9172-8e7dc006c70b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:38.704644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c73ee0-641a-43c1-9172-8e7dc006c70b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:38.716212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 515/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:38.722149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:38.817089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e626-a5a7-4981-a72b-1cdbac1b8d76 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:38.849625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733dfce-3651-4ff8-977a-837a126c676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:38.850281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733dfce-3651-4ff8-977a-837a126c676b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:38.850592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733dfce-3651-4ff8-977a-837a126c676b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:38.850877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733dfce-3651-4ff8-977a-837a126c676b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:38.851716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733dfce-3651-4ff8-977a-837a126c676b None admin] RBAC: Adding query filter params (role.id=0c53d598efad4cf5a9f3225702321c51, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=5b28dcc32b984429939b95e436b4d41e) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:38.852032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733dfce-3651-4ff8-977a-837a126c676b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:38.853515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733dfce-3651-4ff8-977a-837a126c676b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:38.866626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 530/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:38 2022] GET /identity/v3/role_assignments?user.id=5b28dcc32b984429939b95e436b4d41e&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=0c53d598efad4cf5a9f3225702321c51 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:39.121378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fa9e-91ae-45f9-b47b-2829fd70e8a1 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:39.121737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fa9e-91ae-45f9-b47b-2829fd70e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:39.121936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fa9e-91ae-45f9-b47b-2829fd70e8a1 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:39.123479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 516/1046] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:39.128429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568684-b657-48d8-bc50-757651ab57af None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:39.128724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568684-b657-48d8-bc50-757651ab57af None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:39.129005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568684-b657-48d8-bc50-757651ab57af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:39.145578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-bd568684-b657-48d8-bc50-757651ab57af None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:39.146785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-bd568684-b657-48d8-bc50-757651ab57af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:39.211616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 531/1047] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:39.235343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7fa9e-91ae-45f9-b47b-2829fd70e8a1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:39.333185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7fa9e-91ae-45f9-b47b-2829fd70e8a1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:39.366179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a924-7a43-47b3-a56c-933b4aabd4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:39.367010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a924-7a43-47b3-a56c-933b4aabd4cc None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:39.367327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a924-7a43-47b3-a56c-933b4aabd4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:39.367566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a924-7a43-47b3-a56c-933b4aabd4cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:39.379406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6a924-7a43-47b3-a56c-933b4aabd4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:39.387067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-5df6a924-7a43-47b3-a56c-933b4aabd4cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:20:39.388491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 517/1048] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:39.394219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568684-b657-48d8-bc50-757651ab57af None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:39.495296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568684-b657-48d8-bc50-757651ab57af None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:39.528245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:39.528923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:39.529210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:39.529487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:39.530235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:39.531627 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:39.532053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:39.544395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 532/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:20:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:39.545604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a924-7a43-47b3-a56c-933b4aabd4cc None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:39.645368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a924-7a43-47b3-a56c-933b4aabd4cc None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:39.677914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6a429-535d-4b19-947d-54d5423f29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:39.678817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a429-535d-4b19-947d-54d5423f29a0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:39.679107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a429-535d-4b19-947d-54d5423f29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:39.679388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6a429-535d-4b19-947d-54d5423f29a0 None admin] PATH_INFO: `/v3/users/c6f02fe5ed8143fbbf813dc13729bcf4` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:39.692811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6a429-535d-4b19-947d-54d5423f29a0 None admin] RBAC: Authorizing `identity:get_user(user_id=c6f02fe5ed8143fbbf813dc13729bcf4)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:39.694265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6a429-535d-4b19-947d-54d5423f29a0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:39.700464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 518/1050] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:39 2022] GET /identity/v3/users/c6f02fe5ed8143fbbf813dc13729bcf4 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:39.701647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:39.806849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9d85-bbc1-4b3a-9db5-df72338ff5ef None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:39.839097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d16f-97c4-4995-8071-066187eec2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:39.839802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d16f-97c4-4995-8071-066187eec2ca None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:39.840090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d16f-97c4-4995-8071-066187eec2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:39.840372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d16f-97c4-4995-8071-066187eec2ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:39.904830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293d16f-97c4-4995-8071-066187eec2ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:39.906219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293d16f-97c4-4995-8071-066187eec2ca None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:40.003411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 533/1051] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:40.011655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6a429-535d-4b19-947d-54d5423f29a0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:40.117530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6a429-535d-4b19-947d-54d5423f29a0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:40.149716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e9ccb-8840-4f52-9473-8b6a9d0bdbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:40.150604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e9ccb-8840-4f52-9473-8b6a9d0bdbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:40.150900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e9ccb-8840-4f52-9473-8b6a9d0bdbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:40.151178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e9ccb-8840-4f52-9473-8b6a9d0bdbd6 None admin] PATH_INFO: `/v3/projects/982513b01659457287fd73a7a8ce5a7c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:40.152882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e9ccb-8840-4f52-9473-8b6a9d0bdbd6 None admin] RBAC: Authorizing `identity:get_project(project_id=982513b01659457287fd73a7a8ce5a7c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:40.154310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e9ccb-8840-4f52-9473-8b6a9d0bdbd6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:40.156308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 519/1052] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:20:40 2022] GET /identity/v3/projects/982513b01659457287fd73a7a8ce5a7c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:40.162038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d16f-97c4-4995-8071-066187eec2ca None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:40.255823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d16f-97c4-4995-8071-066187eec2ca None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:40.288215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef5add-95f7-4811-b93c-110840e05c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:40.288873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef5add-95f7-4811-b93c-110840e05c8d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:40.289150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef5add-95f7-4811-b93c-110840e05c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:40.289435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef5add-95f7-4811-b93c-110840e05c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:40.290278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef5add-95f7-4811-b93c-110840e05c8d None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=982513b01659457287fd73a7a8ce5a7c, user.id=c6f02fe5ed8143fbbf813dc13729bcf4) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:40.290617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef5add-95f7-4811-b93c-110840e05c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:40.292059 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef5add-95f7-4811-b93c-110840e05c8d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:40.298284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 534/1053] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:40 2022] GET /identity/v3/role_assignments?user.id=c6f02fe5ed8143fbbf813dc13729bcf4&scope.project.id=982513b01659457287fd73a7a8ce5a7c&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:40.525837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46eba9-f413-4ccd-97e6-b6b6f32b54ad None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:40.526329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46eba9-f413-4ccd-97e6-b6b6f32b54ad None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:40.526329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46eba9-f413-4ccd-97e6-b6b6f32b54ad None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:40.527907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 520/1054] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:40.532913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9251-d4d3-4026-ad28-f1f36f7e7e71 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:40.533339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9251-d4d3-4026-ad28-f1f36f7e7e71 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:40.533552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9251-d4d3-4026-ad28-f1f36f7e7e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:40.550551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b26e9251-d4d3-4026-ad28-f1f36f7e7e71 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:40.552023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b26e9251-d4d3-4026-ad28-f1f36f7e7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:40.618583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 535/1055] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:40.639687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46eba9-f413-4ccd-97e6-b6b6f32b54ad None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:40.737902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46eba9-f413-4ccd-97e6-b6b6f32b54ad None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:40.769878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:40.770692 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:40.770980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:40.771259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:40.771914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:40.773361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:40.784748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 28 16:20:40.786071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 521/1056] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Apr 28 16:20:40 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:40.791800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e9251-d4d3-4026-ad28-f1f36f7e7e71 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:40.889818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e9251-d4d3-4026-ad28-f1f36f7e7e71 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:40.926412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:40.927386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:40.927671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:40.927946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:40.928667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:40.928976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:40.930389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:40.940730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 536/1057] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:40.941926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:41.039824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46559ba-01a6-41d3-9b59-039a2d3e11c4 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:41.079669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce18de-ed96-46bb-b09f-848b0490907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:41.080339 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce18de-ed96-46bb-b09f-848b0490907d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.080623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce18de-ed96-46bb-b09f-848b0490907d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.080899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce18de-ed96-46bb-b09f-848b0490907d None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.081606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce18de-ed96-46bb-b09f-848b0490907d None admin] RBAC: Adding query filter params (type=image) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:41.081910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce18de-ed96-46bb-b09f-848b0490907d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:41.083295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce18de-ed96-46bb-b09f-848b0490907d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:41.093218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 522/1058] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:41.094460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:41.096072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9369812-9484-4420-a153-012b769cee7d None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.096362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9369812-9484-4420-a153-012b769cee7d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.096636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9369812-9484-4420-a153-012b769cee7d None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.098092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 523/1059] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:41.103210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811beff9-c729-4aa0-959c-c442ce604152 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.103500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811beff9-c729-4aa0-959c-c442ce604152 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.103780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811beff9-c729-4aa0-959c-c442ce604152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.119995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-811beff9-c729-4aa0-959c-c442ce604152 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:41.121199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-811beff9-c729-4aa0-959c-c442ce604152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:41.189908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 524/1060] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:41.192545 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536248a7-8e16-4510-af6b-af1ccaa6b9f2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:41.212415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811beff9-c729-4aa0-959c-c442ce604152 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:41.227157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21b9a5-3ec9-4a8d-9c32-dca94679b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:41.227820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21b9a5-3ec9-4a8d-9c32-dca94679b465 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.228388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21b9a5-3ec9-4a8d-9c32-dca94679b465 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.228388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21b9a5-3ec9-4a8d-9c32-dca94679b465 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.229139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21b9a5-3ec9-4a8d-9c32-dca94679b465 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:41.230557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21b9a5-3ec9-4a8d-9c32-dca94679b465 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:41.306486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811beff9-c729-4aa0-959c-c442ce604152 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:41.336301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 537/1061] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:20:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:41.346262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df4841-ef10-412c-8c14-22290fb27eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:41.347132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4841-ef10-412c-8c14-22290fb27eeb None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.347416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4841-ef10-412c-8c14-22290fb27eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.347690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df4841-ef10-412c-8c14-22290fb27eeb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.359482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df4841-ef10-412c-8c14-22290fb27eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:41.367292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-96df4841-ef10-412c-8c14-22290fb27eeb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 16:20:41.368818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 525/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Apr 28 16:20:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:41.374942 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21b9a5-3ec9-4a8d-9c32-dca94679b465 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:41.482923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21b9a5-3ec9-4a8d-9c32-dca94679b465 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:41.516590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:41.517274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.517563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.517843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.518634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:41.518943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:41.520319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:41.529282 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 538/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Apr 28 16:20:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:41.535358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df4841-ef10-412c-8c14-22290fb27eeb None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:41.635979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df4841-ef10-412c-8c14-22290fb27eeb None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:41.668758 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:41.669573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.669861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.670140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.680892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:41.682351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:41.699398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:41.700779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 526/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:41.706124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:41.803172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb1055-3c0f-4f34-9952-f0a15668256e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:41.835699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:41.836364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.836651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.836932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.837660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:41.837970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:41.839918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:41.853064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 539/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:41.857232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:41.951649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b4bf9-3cad-46e8-8105-10696576da7a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:41.983909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:41.984755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:41.985039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:41.985312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:41.992857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:41.994281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:42.007429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:20:42.008767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 527/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:20:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:42.014825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:42.110888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21373801-9c60-4b53-aeb5-790b05b887a1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:42.143310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:42.143980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.144263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.144539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.145375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:42.145684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:42.147140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:42.168733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 540/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:20:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:42.169968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:42.265012 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4fbab-d788-4aae-b936-c0c5ee389507 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:42.296778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:42.297572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.297855 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.298130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.308952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:42.310439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:42.326767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:42.327945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 528/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:42.333757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:42.432470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f544-f625-44c8-9dd7-2a0c1403d314 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:42.465252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a1d74-c393-438b-9d74-ed3635777f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:42.465911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a1d74-c393-438b-9d74-ed3635777f3a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.466193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a1d74-c393-438b-9d74-ed3635777f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.466472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a1d74-c393-438b-9d74-ed3635777f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.467220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a1d74-c393-438b-9d74-ed3635777f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:42.467526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a1d74-c393-438b-9d74-ed3635777f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:42.468888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a1d74-c393-438b-9d74-ed3635777f3a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:42.479726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 541/1069] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:42.487943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:42.555955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d5da-45b8-445a-a1d1-4d845260a26d None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.556166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d5da-45b8-445a-a1d1-4d845260a26d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.556663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d5da-45b8-445a-a1d1-4d845260a26d None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.558732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 542/1070] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:42.563628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356993-34c5-4b42-9b4d-329020b8bfa2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.563919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356993-34c5-4b42-9b4d-329020b8bfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.564202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356993-34c5-4b42-9b4d-329020b8bfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.580706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b3356993-34c5-4b42-9b4d-329020b8bfa2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:42.581892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b3356993-34c5-4b42-9b4d-329020b8bfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:42.585594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889e1be-e560-4605-99ce-b8f213a5879d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:42.617622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:42.618414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.618726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.619004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.626023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:42.627495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:42.641832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:42.643198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 529/1071] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:42.648724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:42.649917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 543/1072] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:42.672601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3356993-34c5-4b42-9b4d-329020b8bfa2 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:42.746322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fc62-9076-4afb-9fd2-467c5b7bc867 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:42.780451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:42.781149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.781436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.781741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.782570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:42.782754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3356993-34c5-4b42-9b4d-329020b8bfa2 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:42.783178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:42.784305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:42.796213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 530/1073] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:42.802181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:42.816150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0ed64-1ebf-42b6-9f1d-486fe1bc577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:42.816953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0ed64-1ebf-42b6-9f1d-486fe1bc577f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.817237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0ed64-1ebf-42b6-9f1d-486fe1bc577f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.817514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0ed64-1ebf-42b6-9f1d-486fe1bc577f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.827826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0ed64-1ebf-42b6-9f1d-486fe1bc577f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:42.834697 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-04a0ed64-1ebf-42b6-9f1d-486fe1bc577f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:20:42.836155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 544/1074] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:42.842075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0ed64-1ebf-42b6-9f1d-486fe1bc577f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:42.901110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ec929-89c6-4cc9-bc07-adb9e0473f82 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:42.935369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4bcad-1622-4fd6-a1c1-b057ca19852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:42.936494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4bcad-1622-4fd6-a1c1-b057ca19852b None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.936779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4bcad-1622-4fd6-a1c1-b057ca19852b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.937057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4bcad-1622-4fd6-a1c1-b057ca19852b None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/5b28dcc32b984429939b95e436b4d41e/roles/0c53d598efad4cf5a9f3225702321c51` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.939320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4bcad-1622-4fd6-a1c1-b057ca19852b None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=5b28dcc32b984429939b95e436b4d41e, role_id=0c53d598efad4cf5a9f3225702321c51)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:42.939458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0ed64-1ebf-42b6-9f1d-486fe1bc577f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:42.940760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4bcad-1622-4fd6-a1c1-b057ca19852b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:42.972032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:42.972701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:42.972996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:42.973276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:42.974026 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:42.974338 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:42.975757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:42.984360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 545/1075] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:20:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:42.990213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:43.022815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 531/1076] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:20:42 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/5b28dcc32b984429939b95e436b4d41e/roles/0c53d598efad4cf5a9f3225702321c51 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:20:43.097663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e20573-3531-4550-9e43-b9a108be9d12 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:43.133077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681513-7adc-462b-b193-c2bf524aea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:43.133976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681513-7adc-462b-b193-c2bf524aea81 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:43.134264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681513-7adc-462b-b193-c2bf524aea81 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:43.134561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681513-7adc-462b-b193-c2bf524aea81 None admin] PATH_INFO: `/v3/users/c6f02fe5ed8143fbbf813dc13729bcf4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:43.135826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95681513-7adc-462b-b193-c2bf524aea81 None admin] RBAC: Authorizing `identity:get_user(user_id=c6f02fe5ed8143fbbf813dc13729bcf4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:43.137362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95681513-7adc-462b-b193-c2bf524aea81 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:43.144397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 546/1077] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:42 2022] GET /identity/v3/users/c6f02fe5ed8143fbbf813dc13729bcf4 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:43.145432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4bcad-1622-4fd6-a1c1-b057ca19852b None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:43.250727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4bcad-1622-4fd6-a1c1-b057ca19852b None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:43.283270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1ab53-99f7-4720-91ce-d1d35beeb18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:43.284142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1ab53-99f7-4720-91ce-d1d35beeb18b None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:43.284429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1ab53-99f7-4720-91ce-d1d35beeb18b None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:43.284707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1ab53-99f7-4720-91ce-d1d35beeb18b None admin] PATH_INFO: `/v3/projects/982513b01659457287fd73a7a8ce5a7c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:43.285949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1ab53-99f7-4720-91ce-d1d35beeb18b None admin] RBAC: Authorizing `identity:get_project(project_id=982513b01659457287fd73a7a8ce5a7c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:43.287373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1ab53-99f7-4720-91ce-d1d35beeb18b None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:43.289260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 532/1078] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:20:43 2022] GET /identity/v3/projects/982513b01659457287fd73a7a8ce5a7c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:43.295911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681513-7adc-462b-b193-c2bf524aea81 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:43.392616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681513-7adc-462b-b193-c2bf524aea81 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:43.424648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb786-3c1e-4cbf-a55d-502f99d7182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:43.425552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb786-3c1e-4cbf-a55d-502f99d7182f None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:43.425841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb786-3c1e-4cbf-a55d-502f99d7182f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:43.426119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb786-3c1e-4cbf-a55d-502f99d7182f None admin] PATH_INFO: `/v3/projects/982513b01659457287fd73a7a8ce5a7c/users/c6f02fe5ed8143fbbf813dc13729bcf4/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:43.428397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb786-3c1e-4cbf-a55d-502f99d7182f None admin] RBAC: Authorizing `identity:create_grant(project_id=982513b01659457287fd73a7a8ce5a7c, user_id=c6f02fe5ed8143fbbf813dc13729bcf4, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:43.429844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb786-3c1e-4cbf-a55d-502f99d7182f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:43.535542 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 547/1079] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:20:43 2022] PUT /identity/v3/projects/982513b01659457287fd73a7a8ce5a7c/users/c6f02fe5ed8143fbbf813dc13729bcf4/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:20:43.655151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9c4c-5ae7-49b4-8022-60e6899e1892 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:43.655672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9c4c-5ae7-49b4-8022-60e6899e1892 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:43.655672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9c4c-5ae7-49b4-8022-60e6899e1892 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:43.657276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 533/1080] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:43.662560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c369-560b-4da0-8b52-d762ec098375 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:43.662886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c369-560b-4da0-8b52-d762ec098375 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:43.663175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c369-560b-4da0-8b52-d762ec098375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:43.681532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e2a1c369-560b-4da0-8b52-d762ec098375 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:43.683309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e2a1c369-560b-4da0-8b52-d762ec098375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:43.752424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 548/1081] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:43.774832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca9c4c-5ae7-49b4-8022-60e6899e1892 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:43.873128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca9c4c-5ae7-49b4-8022-60e6899e1892 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:43.905762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6de62e-de39-4bd0-9f6a-f5e9b0231f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:43.906345 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6de62e-de39-4bd0-9f6a-f5e9b0231f2a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:43.906668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6de62e-de39-4bd0-9f6a-f5e9b0231f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:43.906950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6de62e-de39-4bd0-9f6a-f5e9b0231f2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:43.971407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6de62e-de39-4bd0-9f6a-f5e9b0231f2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:43.972903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6de62e-de39-4bd0-9f6a-f5e9b0231f2a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:44.070766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 534/1082] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:44.077078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1c369-560b-4da0-8b52-d762ec098375 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:44.174803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1c369-560b-4da0-8b52-d762ec098375 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:44.208293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f46f6-719f-4b45-8596-113a4aec1afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:44.209097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f46f6-719f-4b45-8596-113a4aec1afa None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:44.209383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f46f6-719f-4b45-8596-113a4aec1afa None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:44.209661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f46f6-719f-4b45-8596-113a4aec1afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:44.219644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f46f6-719f-4b45-8596-113a4aec1afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:44.221115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f46f6-719f-4b45-8596-113a4aec1afa None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:44.238956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-775f46f6-719f-4b45-8596-113a4aec1afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:44.240428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 549/1083] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:44.246727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6de62e-de39-4bd0-9f6a-f5e9b0231f2a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:44.352498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6de62e-de39-4bd0-9f6a-f5e9b0231f2a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:44.391815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2d28-9eb6-4e8a-ad4f-3666c41f3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:44.392492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2d28-9eb6-4e8a-ad4f-3666c41f3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:44.392775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2d28-9eb6-4e8a-ad4f-3666c41f3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:44.393051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2d28-9eb6-4e8a-ad4f-3666c41f3bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:44.393784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2d28-9eb6-4e8a-ad4f-3666c41f3bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:44.394093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2d28-9eb6-4e8a-ad4f-3666c41f3bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:44.396596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2d28-9eb6-4e8a-ad4f-3666c41f3bb1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:44.409697 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 535/1084] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:45.469298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62db2cd-4754-45e5-be2c-8265421c398f None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:45.469878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62db2cd-4754-45e5-be2c-8265421c398f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:45.469878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62db2cd-4754-45e5-be2c-8265421c398f None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:45.471250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 550/1085] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:45.476438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351122-882f-413e-870d-4f10bd079ba7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:45.476835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351122-882f-413e-870d-4f10bd079ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:45.477001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351122-882f-413e-870d-4f10bd079ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:45.493563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e7351122-882f-413e-870d-4f10bd079ba7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:45.494760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e7351122-882f-413e-870d-4f10bd079ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:45.557720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 536/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:45.582901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62db2cd-4754-45e5-be2c-8265421c398f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:45.692263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62db2cd-4754-45e5-be2c-8265421c398f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:45.724017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a281e-d8a5-47cd-9d69-e40b3c198634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:45.724767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a281e-d8a5-47cd-9d69-e40b3c198634 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:45.725052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a281e-d8a5-47cd-9d69-e40b3c198634 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:45.725327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a281e-d8a5-47cd-9d69-e40b3c198634 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:45.735603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a281e-d8a5-47cd-9d69-e40b3c198634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:45.743108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-286a281e-d8a5-47cd-9d69-e40b3c198634 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 28 16:20:45.744327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 551/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Apr 28 16:20:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:45.752057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7351122-882f-413e-870d-4f10bd079ba7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:45.810103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb17b8-01f2-4db7-a952-fd900750d844 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:45.810389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb17b8-01f2-4db7-a952-fd900750d844 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:45.810700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb17b8-01f2-4db7-a952-fd900750d844 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:45.812076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 552/1088] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:20:45.817295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c1f1b-6cf4-4cd9-88c9-edd569363d9b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:45.817583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c1f1b-6cf4-4cd9-88c9-edd569363d9b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:45.817861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c1f1b-6cf4-4cd9-88c9-edd569363d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:45.834123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-463c1f1b-6cf4-4cd9-88c9-edd569363d9b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:45.835378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-463c1f1b-6cf4-4cd9-88c9-edd569363d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:45.847740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7351122-882f-413e-870d-4f10bd079ba7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:45.880757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:45.881433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:45.881718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:45.881995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:45.882782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:45.883092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:45.884460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:45.892330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 537/1089] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Apr 28 16:20:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:45.897979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:45.900506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 553/1090] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:20:45.923925 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c1f1b-6cf4-4cd9-88c9-edd569363d9b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:45.993423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb269f5-c57b-4da1-a8cc-80c0e0835753 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.020433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c1f1b-6cf4-4cd9-88c9-edd569363d9b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.025307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.026098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.026381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.027196 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.037673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.039159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.055681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b12b15-4338-4f9b-b937-84d69e300a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.056483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12b15-4338-4f9b-b937-84d69e300a2d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.056641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:46.056768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12b15-4338-4f9b-b937-84d69e300a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.057047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12b15-4338-4f9b-b937-84d69e300a2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.057871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 538/1091] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:46.063323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.067867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b12b15-4338-4f9b-b937-84d69e300a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:20:46.074770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-a1b12b15-4338-4f9b-b937-84d69e300a2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:20:46.080844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 554/1092] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:46.081713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b12b15-4338-4f9b-b937-84d69e300a2d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.155465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d9d44-250e-4b75-937f-9cd2e9a13720 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.175376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b12b15-4338-4f9b-b937-84d69e300a2d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.187140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.187802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.188089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.188369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.189094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:46.189402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.190798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.201999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 539/1093] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:46.207069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.207448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.207726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.208010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.208286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.209031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:46.209337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.210732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.223700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 555/1094] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:46.224709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.300627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74e6c7-c8ca-4a9a-abbf-856ea1e8cfee None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.318426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cdf7b-221a-445c-92e8-7d7ad9fd9f2d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.336696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.338018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.338505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.339575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.348991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.350445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.354298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cf6bb-9227-4209-b0a0-2e843b653343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.355246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf6bb-9227-4209-b0a0-2e843b653343 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.355531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf6bb-9227-4209-b0a0-2e843b653343 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.355802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf6bb-9227-4209-b0a0-2e843b653343 None admin] PATH_INFO: `/v3/users/c6f02fe5ed8143fbbf813dc13729bcf4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.357025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf6bb-9227-4209-b0a0-2e843b653343 None admin] RBAC: Authorizing `identity:get_user(user_id=c6f02fe5ed8143fbbf813dc13729bcf4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.358455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf6bb-9227-4209-b0a0-2e843b653343 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.360564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 556/1095] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/users/c6f02fe5ed8143fbbf813dc13729bcf4 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:46.365994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 28 16:20:46.365994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 540/1096] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:46.367709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cf6bb-9227-4209-b0a0-2e843b653343 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.371257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.462161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cf6bb-9227-4209-b0a0-2e843b653343 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.462721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9967c-26d0-4aab-8f35-86f1d482b284 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.494052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a284f3-70a8-4da1-aa18-e9dc6320b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.494570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.494937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a284f3-70a8-4da1-aa18-e9dc6320b051 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.495027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.495111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a284f3-70a8-4da1-aa18-e9dc6320b051 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.495219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.495310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a284f3-70a8-4da1-aa18-e9dc6320b051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.495436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.496267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:46.496577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.497995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.514562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 541/1097] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:46.520031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.559379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a284f3-70a8-4da1-aa18-e9dc6320b051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.560770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a284f3-70a8-4da1-aa18-e9dc6320b051 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.611047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe65ff4-52fd-4acf-8531-0c4077014299 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.642682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e8148-8f3c-4116-95d6-8002629d9a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.643334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8148-8f3c-4116-95d6-8002629d9a64 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.643618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8148-8f3c-4116-95d6-8002629d9a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.643895 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8148-8f3c-4116-95d6-8002629d9a64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.655051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 557/1098] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:46.662389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a284f3-70a8-4da1-aa18-e9dc6320b051 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.713137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e8148-8f3c-4116-95d6-8002629d9a64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.714653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e8148-8f3c-4116-95d6-8002629d9a64 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.755740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a284f3-70a8-4da1-aa18-e9dc6320b051 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.788046 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32f993-df00-4f0b-b883-44f549a41000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.788897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f993-df00-4f0b-b883-44f549a41000 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.789183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f993-df00-4f0b-b883-44f549a41000 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.789462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f993-df00-4f0b-b883-44f549a41000 None admin] PATH_INFO: `/v3/projects/982513b01659457287fd73a7a8ce5a7c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.790670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f993-df00-4f0b-b883-44f549a41000 None admin] RBAC: Authorizing `identity:get_project(project_id=982513b01659457287fd73a7a8ce5a7c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.792134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f993-df00-4f0b-b883-44f549a41000 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.798785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 558/1099] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/projects/982513b01659457287fd73a7a8ce5a7c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:46.799713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32f993-df00-4f0b-b883-44f549a41000 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.806136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 542/1100] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 28 16:20:46.812097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e8148-8f3c-4116-95d6-8002629d9a64 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:46.892819 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32f993-df00-4f0b-b883-44f549a41000 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.901988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e8148-8f3c-4116-95d6-8002629d9a64 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:46.924596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.925252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.925542 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.925826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.926964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=982513b01659457287fd73a7a8ce5a7c, user.id=c6f02fe5ed8143fbbf813dc13729bcf4) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:46.927286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.928719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.934616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:46.935011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 559/1101] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/role_assignments?user.id=c6f02fe5ed8143fbbf813dc13729bcf4&scope.project.id=982513b01659457287fd73a7a8ce5a7c&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:46.936488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:46.936849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:46.937218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:46.947858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:46.949972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:46.968298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:20:46.969585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 543/1102] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:20:46.975596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:47.085100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c56df-a1b6-4916-8f09-5988f31819b1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:47.118577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:47.119274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:47.119544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:47.119825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:47.121095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:47.122027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:47.122844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:47.134508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 560/1103] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:20:47.140435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:47.234455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21738ba8-b29f-41ac-a49d-968b907d57d7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:47.266208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:47.267039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:47.267324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:47.267601 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:47.274008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:47.275478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:47.288311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:20:47.289493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 544/1104] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:20:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:20:47.295975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:47.389345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1d98-1cd0-4538-a108-f57fe1fb86f5 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:47.421208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5756b4-7766-4a5f-b7d2-7cfada57c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:47.421862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5756b4-7766-4a5f-b7d2-7cfada57c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:47.422147 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5756b4-7766-4a5f-b7d2-7cfada57c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:47.422425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5756b4-7766-4a5f-b7d2-7cfada57c0a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:47.423241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5756b4-7766-4a5f-b7d2-7cfada57c0a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:47.423551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5756b4-7766-4a5f-b7d2-7cfada57c0a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:47.424970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5756b4-7766-4a5f-b7d2-7cfada57c0a3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:47.436726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 561/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:20:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:47.442709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:47.536579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6a5cf-6310-46e1-8eb3-63705f90dc23 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:47.568131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c173f-16bf-411b-92ba-a7d6b869fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:47.568778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c173f-16bf-411b-92ba-a7d6b869fb50 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:47.569068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c173f-16bf-411b-92ba-a7d6b869fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:47.569346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c173f-16bf-411b-92ba-a7d6b869fb50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:47.570184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c173f-16bf-411b-92ba-a7d6b869fb50 None admin] RBAC: Adding query filter params (role.id=0c53d598efad4cf5a9f3225702321c51, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=5b28dcc32b984429939b95e436b4d41e) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:47.570500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c173f-16bf-411b-92ba-a7d6b869fb50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:47.571957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c173f-16bf-411b-92ba-a7d6b869fb50 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:47.577559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 545/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:47 2022] GET /identity/v3/role_assignments?user.id=5b28dcc32b984429939b95e436b4d41e&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=0c53d598efad4cf5a9f3225702321c51 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:49.303085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de534-bd6b-4eea-a3ca-a8aa510dfd76 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:49.303599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de534-bd6b-4eea-a3ca-a8aa510dfd76 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:49.303599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de534-bd6b-4eea-a3ca-a8aa510dfd76 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:49.304939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 562/1107] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:49.310521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c325c-5767-4641-8a6d-d3685fb635ce None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:49.311010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c325c-5767-4641-8a6d-d3685fb635ce None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:49.311176 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c325c-5767-4641-8a6d-d3685fb635ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:49.327894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-669c325c-5767-4641-8a6d-d3685fb635ce None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:49.329120 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-669c325c-5767-4641-8a6d-d3685fb635ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:49.392912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 546/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:49.419507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8de534-bd6b-4eea-a3ca-a8aa510dfd76 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:49.526560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8de534-bd6b-4eea-a3ca-a8aa510dfd76 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:49.563409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bbbf2-0d25-4354-9909-30cb0bca560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:49.564192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bbbf2-0d25-4354-9909-30cb0bca560e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:49.564474 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bbbf2-0d25-4354-9909-30cb0bca560e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:49.564749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bbbf2-0d25-4354-9909-30cb0bca560e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:49.565897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bbbf2-0d25-4354-9909-30cb0bca560e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:49.567343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bbbf2-0d25-4354-9909-30cb0bca560e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:49.568945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 563/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:20:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:49.574873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c325c-5767-4641-8a6d-d3685fb635ce None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:49.668812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c325c-5767-4641-8a6d-d3685fb635ce None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:49.700867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4ee82-f9b3-4415-962d-815461846131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:49.701527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ee82-f9b3-4415-962d-815461846131 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:49.701813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ee82-f9b3-4415-962d-815461846131 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:49.702091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ee82-f9b3-4415-962d-815461846131 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:49.702824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4ee82-f9b3-4415-962d-815461846131 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:49.704258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4ee82-f9b3-4415-962d-815461846131 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:49.808463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 547/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:20:49 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:20:52.052569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a868fce-6492-4701-9d5f-fae2c795852c None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:52.052960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a868fce-6492-4701-9d5f-fae2c795852c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:52.053138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a868fce-6492-4701-9d5f-fae2c795852c None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:52.054515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 564/1111] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:52.060266 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292eb20-351d-4daf-83a7-a174e94b8ab1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:52.060676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292eb20-351d-4daf-83a7-a174e94b8ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:52.060823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292eb20-351d-4daf-83a7-a174e94b8ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:52.077483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f292eb20-351d-4daf-83a7-a174e94b8ab1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:52.078682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f292eb20-351d-4daf-83a7-a174e94b8ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:52.140512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 548/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:52.163421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a868fce-6492-4701-9d5f-fae2c795852c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:52.257991 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a868fce-6492-4701-9d5f-fae2c795852c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:52.289564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0bd7c-9fe3-434a-b6b6-315d2d34c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:52.290396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bd7c-9fe3-434a-b6b6-315d2d34c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:52.290709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bd7c-9fe3-434a-b6b6-315d2d34c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:52.291011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bd7c-9fe3-434a-b6b6-315d2d34c1d3 None admin] PATH_INFO: `/v3/roles/caa40465e0b0487aa66fec9cda30ce92` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:52.292498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0bd7c-9fe3-434a-b6b6-315d2d34c1d3 None admin] RBAC: Authorizing `identity:get_role(role_id=caa40465e0b0487aa66fec9cda30ce92)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:52.293854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0bd7c-9fe3-434a-b6b6-315d2d34c1d3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:52.295223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 565/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:52 2022] GET /identity/v3/roles/caa40465e0b0487aa66fec9cda30ce92 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:52.300749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292eb20-351d-4daf-83a7-a174e94b8ab1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:52.392688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292eb20-351d-4daf-83a7-a174e94b8ab1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:52.423673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa087d-4747-4bc7-8c3b-2136e5d9bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:52.424515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa087d-4747-4bc7-8c3b-2136e5d9bd19 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:52.424794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa087d-4747-4bc7-8c3b-2136e5d9bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:52.425065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa087d-4747-4bc7-8c3b-2136e5d9bd19 None admin] PATH_INFO: `/v3/users/eaa22f025c854667a6f32b809455cba6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:52.437947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa087d-4747-4bc7-8c3b-2136e5d9bd19 None admin] RBAC: Authorizing `identity:get_user(user_id=eaa22f025c854667a6f32b809455cba6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:52.439398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa087d-4747-4bc7-8c3b-2136e5d9bd19 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:52.440993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 549/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:52 2022] GET /identity/v3/users/eaa22f025c854667a6f32b809455cba6 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:52.446664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0bd7c-9fe3-434a-b6b6-315d2d34c1d3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:52.539285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0bd7c-9fe3-434a-b6b6-315d2d34c1d3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:52.572022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf0c0a-cc1d-4120-93a8-62604b2e3b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:52.572662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0c0a-cc1d-4120-93a8-62604b2e3b46 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:52.572948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0c0a-cc1d-4120-93a8-62604b2e3b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:52.573254 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0c0a-cc1d-4120-93a8-62604b2e3b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:52.636501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf0c0a-cc1d-4120-93a8-62604b2e3b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:52.637962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf0c0a-cc1d-4120-93a8-62604b2e3b46 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:52.729181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 566/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:52.735887 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa087d-4747-4bc7-8c3b-2136e5d9bd19 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:52.828183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa087d-4747-4bc7-8c3b-2136e5d9bd19 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:52.860345 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882f558-2e64-4429-875a-43e6378eae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:52.861196 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882f558-2e64-4429-875a-43e6378eae12 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:52.861476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882f558-2e64-4429-875a-43e6378eae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:52.861748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882f558-2e64-4429-875a-43e6378eae12 None admin] PATH_INFO: `/v3/projects/982513b01659457287fd73a7a8ce5a7c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:52.862930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882f558-2e64-4429-875a-43e6378eae12 None admin] RBAC: Authorizing `identity:get_project(project_id=982513b01659457287fd73a7a8ce5a7c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:52.864341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882f558-2e64-4429-875a-43e6378eae12 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:52.866013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 550/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:20:52 2022] GET /identity/v3/projects/982513b01659457287fd73a7a8ce5a7c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:52.872057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf0c0a-cc1d-4120-93a8-62604b2e3b46 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:52.964711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf0c0a-cc1d-4120-93a8-62604b2e3b46 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:52.996457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0aa31-8728-4d45-8e14-3bae6f8dfb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:52.997097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0aa31-8728-4d45-8e14-3bae6f8dfb79 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:52.997382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0aa31-8728-4d45-8e14-3bae6f8dfb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:52.997662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0aa31-8728-4d45-8e14-3bae6f8dfb79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:52.998491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0aa31-8728-4d45-8e14-3bae6f8dfb79 None admin] RBAC: Adding query filter params (role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=982513b01659457287fd73a7a8ce5a7c, user.id=eaa22f025c854667a6f32b809455cba6) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:52.998839 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0aa31-8728-4d45-8e14-3bae6f8dfb79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:53.000287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0aa31-8728-4d45-8e14-3bae6f8dfb79 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:53.005450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 567/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:52 2022] GET /identity/v3/role_assignments?user.id=eaa22f025c854667a6f32b809455cba6&scope.project.id=982513b01659457287fd73a7a8ce5a7c&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:55.194946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7fcf-1044-4000-aacd-40174f09edeb None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:55.195489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7fcf-1044-4000-aacd-40174f09edeb None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:55.195489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df7fcf-1044-4000-aacd-40174f09edeb None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:55.196860 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 551/1118] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:55.202212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48180d-cd21-4880-a4c6-fb658032a531 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:55.202640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48180d-cd21-4880-a4c6-fb658032a531 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:55.202820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48180d-cd21-4880-a4c6-fb658032a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:55.219514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1e48180d-cd21-4880-a4c6-fb658032a531 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:55.220704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1e48180d-cd21-4880-a4c6-fb658032a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:55.283131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 568/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:55.306287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df7fcf-1044-4000-aacd-40174f09edeb None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:55.398394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df7fcf-1044-4000-aacd-40174f09edeb None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:55.429904 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58db66-96c2-415a-b899-ba1490351d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:55.430769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58db66-96c2-415a-b899-ba1490351d53 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:55.431054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58db66-96c2-415a-b899-ba1490351d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:55.431325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58db66-96c2-415a-b899-ba1490351d53 None admin] PATH_INFO: `/v3/roles/caa40465e0b0487aa66fec9cda30ce92` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:55.432802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58db66-96c2-415a-b899-ba1490351d53 None admin] RBAC: Authorizing `identity:get_role(role_id=caa40465e0b0487aa66fec9cda30ce92)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:55.434150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58db66-96c2-415a-b899-ba1490351d53 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:55.435526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 552/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:55 2022] GET /identity/v3/roles/caa40465e0b0487aa66fec9cda30ce92 => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:55.441174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48180d-cd21-4880-a4c6-fb658032a531 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:55.540924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48180d-cd21-4880-a4c6-fb658032a531 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:55.572642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d137f9-5e1e-4b0b-affa-9e066ca71106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:55.574018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d137f9-5e1e-4b0b-affa-9e066ca71106 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:55.574301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d137f9-5e1e-4b0b-affa-9e066ca71106 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:55.574609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d137f9-5e1e-4b0b-affa-9e066ca71106 None admin] PATH_INFO: `/v3/users/eaa22f025c854667a6f32b809455cba6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:55.575794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d137f9-5e1e-4b0b-affa-9e066ca71106 None admin] RBAC: Authorizing `identity:get_user(user_id=eaa22f025c854667a6f32b809455cba6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:55.577228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d137f9-5e1e-4b0b-affa-9e066ca71106 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:55.578898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 569/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:55 2022] GET /identity/v3/users/eaa22f025c854667a6f32b809455cba6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:55.584800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58db66-96c2-415a-b899-ba1490351d53 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:55.677254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58db66-96c2-415a-b899-ba1490351d53 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:55.713984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64784f-da05-482e-9dd7-81d2a9a118a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:55.714865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64784f-da05-482e-9dd7-81d2a9a118a0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:55.715154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64784f-da05-482e-9dd7-81d2a9a118a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:55.715433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64784f-da05-482e-9dd7-81d2a9a118a0 None admin] PATH_INFO: `/v3/projects/982513b01659457287fd73a7a8ce5a7c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:55.716600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64784f-da05-482e-9dd7-81d2a9a118a0 None admin] RBAC: Authorizing `identity:get_project(project_id=982513b01659457287fd73a7a8ce5a7c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:55.718023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64784f-da05-482e-9dd7-81d2a9a118a0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:55.719739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 553/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:20:55 2022] GET /identity/v3/projects/982513b01659457287fd73a7a8ce5a7c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:55.725681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d137f9-5e1e-4b0b-affa-9e066ca71106 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:55.824842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d137f9-5e1e-4b0b-affa-9e066ca71106 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:55.856239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c680eee-c381-417a-9aea-323aab20b431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:55.857118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680eee-c381-417a-9aea-323aab20b431 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:55.857401 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680eee-c381-417a-9aea-323aab20b431 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:55.857676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c680eee-c381-417a-9aea-323aab20b431 None admin] PATH_INFO: `/v3/projects/982513b01659457287fd73a7a8ce5a7c/users/eaa22f025c854667a6f32b809455cba6/roles/caa40465e0b0487aa66fec9cda30ce92` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:55.859889 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c680eee-c381-417a-9aea-323aab20b431 None admin] RBAC: Authorizing `identity:create_grant(project_id=982513b01659457287fd73a7a8ce5a7c, user_id=eaa22f025c854667a6f32b809455cba6, role_id=caa40465e0b0487aa66fec9cda30ce92)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:55.861329 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c680eee-c381-417a-9aea-323aab20b431 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:55.945236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 570/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:20:55 2022] PUT /identity/v3/projects/982513b01659457287fd73a7a8ce5a7c/users/eaa22f025c854667a6f32b809455cba6/roles/caa40465e0b0487aa66fec9cda30ce92 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:20:58.168977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a9553-8d62-4ec6-8e64-782983d73e0a None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:58.169525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a9553-8d62-4ec6-8e64-782983d73e0a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:58.169525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a9553-8d62-4ec6-8e64-782983d73e0a None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:58.170925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 554/1124] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:20:58.176513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb39ef-06d6-444b-8acd-8bfa0f3a1bec None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:58.176912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb39ef-06d6-444b-8acd-8bfa0f3a1bec None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:58.177083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb39ef-06d6-444b-8acd-8bfa0f3a1bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:58.193325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-90eb39ef-06d6-444b-8acd-8bfa0f3a1bec None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:20:58.194519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-90eb39ef-06d6-444b-8acd-8bfa0f3a1bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:20:58.258413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 571/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:20:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:20:58.282830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a9553-8d62-4ec6-8e64-782983d73e0a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:58.376953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a9553-8d62-4ec6-8e64-782983d73e0a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:58.408826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8da6-2bfa-454c-8207-5a3199b04f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:58.409673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8da6-2bfa-454c-8207-5a3199b04f09 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:58.409959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8da6-2bfa-454c-8207-5a3199b04f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:58.410239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8da6-2bfa-454c-8207-5a3199b04f09 None admin] PATH_INFO: `/v3/roles/caa40465e0b0487aa66fec9cda30ce92` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:58.411737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8da6-2bfa-454c-8207-5a3199b04f09 None admin] RBAC: Authorizing `identity:get_role(role_id=caa40465e0b0487aa66fec9cda30ce92)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:58.413096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8da6-2bfa-454c-8207-5a3199b04f09 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:58.414427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 555/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:58 2022] GET /identity/v3/roles/caa40465e0b0487aa66fec9cda30ce92 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:58.420163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb39ef-06d6-444b-8acd-8bfa0f3a1bec None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:58.514299 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb39ef-06d6-444b-8acd-8bfa0f3a1bec None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:58.545733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71614d8-0526-40e5-9da1-05dd94fd38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:58.546612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71614d8-0526-40e5-9da1-05dd94fd38b3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:58.546898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71614d8-0526-40e5-9da1-05dd94fd38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:58.547177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71614d8-0526-40e5-9da1-05dd94fd38b3 None admin] PATH_INFO: `/v3/users/eaa22f025c854667a6f32b809455cba6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:58.548342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71614d8-0526-40e5-9da1-05dd94fd38b3 None admin] RBAC: Authorizing `identity:get_user(user_id=eaa22f025c854667a6f32b809455cba6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:58.549762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71614d8-0526-40e5-9da1-05dd94fd38b3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:58.551656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 572/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:20:58 2022] GET /identity/v3/users/eaa22f025c854667a6f32b809455cba6 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:58.557592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8da6-2bfa-454c-8207-5a3199b04f09 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:58.650102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8da6-2bfa-454c-8207-5a3199b04f09 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:58.683330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb73c9-48c1-4c44-9853-28fd782b199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:58.683962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb73c9-48c1-4c44-9853-28fd782b199e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:58.684245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb73c9-48c1-4c44-9853-28fd782b199e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:58.684523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb73c9-48c1-4c44-9853-28fd782b199e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:58.746862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb73c9-48c1-4c44-9853-28fd782b199e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:58.748294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb73c9-48c1-4c44-9853-28fd782b199e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:58.839122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 556/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:20:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:20:58.844907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71614d8-0526-40e5-9da1-05dd94fd38b3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:58.937534 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71614d8-0526-40e5-9da1-05dd94fd38b3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:58.968977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef900967-da24-45b6-91fc-0a1a9714ee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:58.969811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900967-da24-45b6-91fc-0a1a9714ee7c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:58.970087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900967-da24-45b6-91fc-0a1a9714ee7c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:58.970357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900967-da24-45b6-91fc-0a1a9714ee7c None admin] PATH_INFO: `/v3/projects/982513b01659457287fd73a7a8ce5a7c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:58.971541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef900967-da24-45b6-91fc-0a1a9714ee7c None admin] RBAC: Authorizing `identity:get_project(project_id=982513b01659457287fd73a7a8ce5a7c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:58.972946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef900967-da24-45b6-91fc-0a1a9714ee7c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:58.974611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 573/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:20:58 2022] GET /identity/v3/projects/982513b01659457287fd73a7a8ce5a7c => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:20:58.980511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb73c9-48c1-4c44-9853-28fd782b199e None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:20:59.073648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb73c9-48c1-4c44-9853-28fd782b199e None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:20:59.105153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8d826-c433-4e03-ac1e-b0013a195f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:20:59.105800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d826-c433-4e03-ac1e-b0013a195f2d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:20:59.106086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d826-c433-4e03-ac1e-b0013a195f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:20:59.106364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8d826-c433-4e03-ac1e-b0013a195f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:20:59.107227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8d826-c433-4e03-ac1e-b0013a195f2d None admin] RBAC: Adding query filter params (role.id=caa40465e0b0487aa66fec9cda30ce92, scope.project.id=982513b01659457287fd73a7a8ce5a7c, user.id=eaa22f025c854667a6f32b809455cba6) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:20:59.107541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8d826-c433-4e03-ac1e-b0013a195f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:20:59.108950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8d826-c433-4e03-ac1e-b0013a195f2d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:20:59.114444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 557/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:20:58 2022] GET /identity/v3/role_assignments?user.id=eaa22f025c854667a6f32b809455cba6&scope.project.id=982513b01659457287fd73a7a8ce5a7c&role.id=caa40465e0b0487aa66fec9cda30ce92 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:01.336317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340683-c896-40c6-bd95-79f1191f432f None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:01.336849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340683-c896-40c6-bd95-79f1191f432f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:01.336944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340683-c896-40c6-bd95-79f1191f432f None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:01.338256 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 574/1131] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:01.343431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30e486-44eb-4028-b18a-44487562c598 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:01.343845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30e486-44eb-4028-b18a-44487562c598 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:01.343998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30e486-44eb-4028-b18a-44487562c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:01.360619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-df30e486-44eb-4028-b18a-44487562c598 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:01.361818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-df30e486-44eb-4028-b18a-44487562c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:01.424080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 558/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:01.447677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27340683-c896-40c6-bd95-79f1191f432f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:01.549312 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27340683-c896-40c6-bd95-79f1191f432f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:01.603148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b662f21-2d1e-4418-8f9e-6f1d452d545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:01.603878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662f21-2d1e-4418-8f9e-6f1d452d545b None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:01.604655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662f21-2d1e-4418-8f9e-6f1d452d545b None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:01.604933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b662f21-2d1e-4418-8f9e-6f1d452d545b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:01.606099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662f21-2d1e-4418-8f9e-6f1d452d545b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:01.607557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b662f21-2d1e-4418-8f9e-6f1d452d545b None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:01.609177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 575/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:21:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:01.615094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30e486-44eb-4028-b18a-44487562c598 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:01.706681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30e486-44eb-4028-b18a-44487562c598 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:01.740460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7d9c6-b397-4d0f-ad6a-f77ae45545b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:01.741114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d9c6-b397-4d0f-ad6a-f77ae45545b0 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:01.741642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d9c6-b397-4d0f-ad6a-f77ae45545b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:01.742051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d9c6-b397-4d0f-ad6a-f77ae45545b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:01.742814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7d9c6-b397-4d0f-ad6a-f77ae45545b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:01.744244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7d9c6-b397-4d0f-ad6a-f77ae45545b0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:01.836771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 559/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:21:01 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:21:04.116557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2845-8bc1-4b67-b687-232fdb90272e None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:04.117073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2845-8bc1-4b67-b687-232fdb90272e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:04.117167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb2845-8bc1-4b67-b687-232fdb90272e None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:04.118479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 576/1135] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:04.124134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fd208-b7a2-4a18-8808-59819196fb64 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:04.124547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fd208-b7a2-4a18-8808-59819196fb64 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:04.124703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fd208-b7a2-4a18-8808-59819196fb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:04.141588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-da1fd208-b7a2-4a18-8808-59819196fb64 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:04.142809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-da1fd208-b7a2-4a18-8808-59819196fb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:04.215864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 560/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:04.250496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb2845-8bc1-4b67-b687-232fdb90272e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:04.344731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb2845-8bc1-4b67-b687-232fdb90272e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:04.376683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d658bac-a84d-4106-b236-3d5662c0f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:04.377458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d658bac-a84d-4106-b236-3d5662c0f855 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:04.377742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d658bac-a84d-4106-b236-3d5662c0f855 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:04.378012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d658bac-a84d-4106-b236-3d5662c0f855 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:04.379164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d658bac-a84d-4106-b236-3d5662c0f855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:04.380589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d658bac-a84d-4106-b236-3d5662c0f855 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:04.382183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 577/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:21:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:04.387964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fd208-b7a2-4a18-8808-59819196fb64 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:04.481452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fd208-b7a2-4a18-8808-59819196fb64 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:04.513271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f01cd4-6117-4746-a557-65d858f2a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:04.513926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f01cd4-6117-4746-a557-65d858f2a98e None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:04.514216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f01cd4-6117-4746-a557-65d858f2a98e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:04.514492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f01cd4-6117-4746-a557-65d858f2a98e None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:04.515228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f01cd4-6117-4746-a557-65d858f2a98e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:04.516671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f01cd4-6117-4746-a557-65d858f2a98e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:04.654414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 561/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:21:04 2022] POST /identity/v3/users => generated 286 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:21:06.907901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eecf4d-6c83-4670-b5e1-ef2ec6dd72cd None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:06.908520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eecf4d-6c83-4670-b5e1-ef2ec6dd72cd None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:06.908520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eecf4d-6c83-4670-b5e1-ef2ec6dd72cd None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:06.909818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 578/1139] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:06.915023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb35a-9285-4d6f-b2ac-796d8f48f62c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:06.915440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb35a-9285-4d6f-b2ac-796d8f48f62c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:06.915573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb35a-9285-4d6f-b2ac-796d8f48f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:06.932378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ccfeb35a-9285-4d6f-b2ac-796d8f48f62c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:06.934125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ccfeb35a-9285-4d6f-b2ac-796d8f48f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:06.995472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 562/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:07.017748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eecf4d-6c83-4670-b5e1-ef2ec6dd72cd None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:07.113261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eecf4d-6c83-4670-b5e1-ef2ec6dd72cd None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:07.144359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea4b86-b5fa-4de7-b748-3e1676583c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:07.145139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4b86-b5fa-4de7-b748-3e1676583c2f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:07.145425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4b86-b5fa-4de7-b748-3e1676583c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:07.145702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4b86-b5fa-4de7-b748-3e1676583c2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:07.155812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea4b86-b5fa-4de7-b748-3e1676583c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:21:07.162786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-34ea4b86-b5fa-4de7-b748-3e1676583c2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:21:07.163923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 579/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:21:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:21:07.170366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb35a-9285-4d6f-b2ac-796d8f48f62c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:07.261832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb35a-9285-4d6f-b2ac-796d8f48f62c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:07.294893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:07.295552 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:07.295840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:07.296117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:07.296863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:07.297171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:07.298717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:07.306679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 563/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:07.312397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea4b86-b5fa-4de7-b748-3e1676583c2f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:07.411489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea4b86-b5fa-4de7-b748-3e1676583c2f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:07.444286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c432b3e-2b8e-48b7-a040-0e300253a014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:07.444286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432b3e-2b8e-48b7-a040-0e300253a014 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:07.444286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432b3e-2b8e-48b7-a040-0e300253a014 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:07.444286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c432b3e-2b8e-48b7-a040-0e300253a014 None admin] PATH_INFO: `/v3/users/7e841fa8a53f40a78d52e4fd5f69603e` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:07.457103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c432b3e-2b8e-48b7-a040-0e300253a014 None admin] RBAC: Authorizing `identity:get_user(user_id=7e841fa8a53f40a78d52e4fd5f69603e)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:07.458527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c432b3e-2b8e-48b7-a040-0e300253a014 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:07.460175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 580/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:21:07 2022] GET /identity/v3/users/7e841fa8a53f40a78d52e4fd5f69603e => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:07.466631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:07.558349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd430-e1c9-4108-8ef5-6e1cbeefde72 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:07.590111 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfee9a-a1b9-4f57-b54d-471a1ef5d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:07.590775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfee9a-a1b9-4f57-b54d-471a1ef5d977 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:07.591060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfee9a-a1b9-4f57-b54d-471a1ef5d977 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:07.591335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfee9a-a1b9-4f57-b54d-471a1ef5d977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:07.652739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfee9a-a1b9-4f57-b54d-471a1ef5d977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:07.654170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfee9a-a1b9-4f57-b54d-471a1ef5d977 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:07.745483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 564/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:21:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:21:07.751211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c432b3e-2b8e-48b7-a040-0e300253a014 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:07.844243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c432b3e-2b8e-48b7-a040-0e300253a014 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:07.875727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6f28-2cbf-49f1-8c3d-dcb85aec23f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:07.876568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6f28-2cbf-49f1-8c3d-dcb85aec23f6 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:07.876852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6f28-2cbf-49f1-8c3d-dcb85aec23f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:07.877131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6f28-2cbf-49f1-8c3d-dcb85aec23f6 None admin] PATH_INFO: `/v3/projects/9a857c6e39cc464cb99e03167ebbde5e` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:07.878318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6f28-2cbf-49f1-8c3d-dcb85aec23f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9a857c6e39cc464cb99e03167ebbde5e)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:07.879777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6f28-2cbf-49f1-8c3d-dcb85aec23f6 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:07.881437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 581/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:21:07 2022] GET /identity/v3/projects/9a857c6e39cc464cb99e03167ebbde5e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:07.887866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfee9a-a1b9-4f57-b54d-471a1ef5d977 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:07.980995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfee9a-a1b9-4f57-b54d-471a1ef5d977 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:08.013656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6fc3a-d23d-4538-94b4-2c1c5822b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:08.014241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6fc3a-d23d-4538-94b4-2c1c5822b03c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:08.014526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6fc3a-d23d-4538-94b4-2c1c5822b03c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:08.014827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6fc3a-d23d-4538-94b4-2c1c5822b03c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:08.015660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6fc3a-d23d-4538-94b4-2c1c5822b03c None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=9a857c6e39cc464cb99e03167ebbde5e, user.id=7e841fa8a53f40a78d52e4fd5f69603e) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:08.015971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6fc3a-d23d-4538-94b4-2c1c5822b03c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:08.017430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6fc3a-d23d-4538-94b4-2c1c5822b03c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:08.022801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 565/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:21:07 2022] GET /identity/v3/role_assignments?user.id=7e841fa8a53f40a78d52e4fd5f69603e&scope.project.id=9a857c6e39cc464cb99e03167ebbde5e&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:21:10.219587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeab55-912e-4faf-a050-fa90ac0f3847 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:10.220193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeab55-912e-4faf-a050-fa90ac0f3847 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:10.220193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aeab55-912e-4faf-a050-fa90ac0f3847 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:10.221524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 582/1147] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:10.227015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42458c-8d86-4fe7-9fac-6084df49b7a0 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:10.227424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42458c-8d86-4fe7-9fac-6084df49b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:10.227577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42458c-8d86-4fe7-9fac-6084df49b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:10.248068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3f42458c-8d86-4fe7-9fac-6084df49b7a0 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:10.250480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3f42458c-8d86-4fe7-9fac-6084df49b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:10.311245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 566/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:10.333495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeab55-912e-4faf-a050-fa90ac0f3847 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:10.428797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aeab55-912e-4faf-a050-fa90ac0f3847 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:10.460586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c14315-8848-4e36-a9da-a6d3fd5dcef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:10.461367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14315-8848-4e36-a9da-a6d3fd5dcef7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:10.461657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14315-8848-4e36-a9da-a6d3fd5dcef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:10.461939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14315-8848-4e36-a9da-a6d3fd5dcef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:10.472232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c14315-8848-4e36-a9da-a6d3fd5dcef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:21:10.479192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-72c14315-8848-4e36-a9da-a6d3fd5dcef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:21:10.480392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 583/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:21:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:21:10.486491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42458c-8d86-4fe7-9fac-6084df49b7a0 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:10.585305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42458c-8d86-4fe7-9fac-6084df49b7a0 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:10.617140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:10.617797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:10.618081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:10.618356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:10.619141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:10.619447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:10.620834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:10.628405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 567/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:21:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:10.634414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c14315-8848-4e36-a9da-a6d3fd5dcef7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:10.728047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c14315-8848-4e36-a9da-a6d3fd5dcef7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:10.758860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef1874-f07b-4c0d-b4e5-8a9990a91b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:10.759705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef1874-f07b-4c0d-b4e5-8a9990a91b03 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:10.759988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef1874-f07b-4c0d-b4e5-8a9990a91b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:10.760260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef1874-f07b-4c0d-b4e5-8a9990a91b03 None admin] PATH_INFO: `/v3/users/7e841fa8a53f40a78d52e4fd5f69603e` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:10.761990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef1874-f07b-4c0d-b4e5-8a9990a91b03 None admin] RBAC: Authorizing `identity:get_user(user_id=7e841fa8a53f40a78d52e4fd5f69603e)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:10.763435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef1874-f07b-4c0d-b4e5-8a9990a91b03 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:10.765017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 584/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:21:10 2022] GET /identity/v3/users/7e841fa8a53f40a78d52e4fd5f69603e => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:10.771002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:10.862974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7ee4f-ecf8-40b8-a7cc-f1c424dece2a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:10.896748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f2f18-1385-44cb-b011-a35214508263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:10.897609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f2f18-1385-44cb-b011-a35214508263 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:10.897893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f2f18-1385-44cb-b011-a35214508263 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:10.898168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f2f18-1385-44cb-b011-a35214508263 None admin] PATH_INFO: `/v3/projects/9a857c6e39cc464cb99e03167ebbde5e` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:10.899375 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f2f18-1385-44cb-b011-a35214508263 None admin] RBAC: Authorizing `identity:get_project(project_id=9a857c6e39cc464cb99e03167ebbde5e)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:10.900847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f2f18-1385-44cb-b011-a35214508263 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:10.902565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 568/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:21:10 2022] GET /identity/v3/projects/9a857c6e39cc464cb99e03167ebbde5e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:10.908678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef1874-f07b-4c0d-b4e5-8a9990a91b03 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:11.002671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef1874-f07b-4c0d-b4e5-8a9990a91b03 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:11.034057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ad06-71df-4a47-b24a-65c65c2df6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:11.034958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ad06-71df-4a47-b24a-65c65c2df6c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:11.035250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ad06-71df-4a47-b24a-65c65c2df6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:11.035531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ad06-71df-4a47-b24a-65c65c2df6c4 None admin] PATH_INFO: `/v3/projects/9a857c6e39cc464cb99e03167ebbde5e/users/7e841fa8a53f40a78d52e4fd5f69603e/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:11.037525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ad06-71df-4a47-b24a-65c65c2df6c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a857c6e39cc464cb99e03167ebbde5e, user_id=7e841fa8a53f40a78d52e4fd5f69603e, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:11.039009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ad06-71df-4a47-b24a-65c65c2df6c4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:11.138056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 585/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:21:10 2022] PUT /identity/v3/projects/9a857c6e39cc464cb99e03167ebbde5e/users/7e841fa8a53f40a78d52e4fd5f69603e/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:21:13.336975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134eb28-a422-482e-9825-a0105c3ff7ed None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:13.337481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134eb28-a422-482e-9825-a0105c3ff7ed None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:13.337590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134eb28-a422-482e-9825-a0105c3ff7ed None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:13.339482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 569/1154] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:13.344662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200d75-5465-4ed6-bf89-36e20cef0472 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:13.345088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200d75-5465-4ed6-bf89-36e20cef0472 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:13.345226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200d75-5465-4ed6-bf89-36e20cef0472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:13.361660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-37200d75-5465-4ed6-bf89-36e20cef0472 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:13.362862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-37200d75-5465-4ed6-bf89-36e20cef0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:13.424496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 586/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:13.447603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134eb28-a422-482e-9825-a0105c3ff7ed None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:13.543886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134eb28-a422-482e-9825-a0105c3ff7ed None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:13.575294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5891d0-4d0f-434a-9ad5-f67324ac1c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:13.576077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5891d0-4d0f-434a-9ad5-f67324ac1c93 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:13.576365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5891d0-4d0f-434a-9ad5-f67324ac1c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:13.576641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5891d0-4d0f-434a-9ad5-f67324ac1c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:13.586606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5891d0-4d0f-434a-9ad5-f67324ac1c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:21:13.594195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-0b5891d0-4d0f-434a-9ad5-f67324ac1c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:21:13.595344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 570/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:21:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:21:13.601358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37200d75-5465-4ed6-bf89-36e20cef0472 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:13.693408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37200d75-5465-4ed6-bf89-36e20cef0472 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:13.725446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:13.726107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:13.726397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:13.726709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:13.727459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:13.727769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:13.729133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:13.736826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 587/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:21:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:13.742451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5891d0-4d0f-434a-9ad5-f67324ac1c93 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:13.849312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5891d0-4d0f-434a-9ad5-f67324ac1c93 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:13.881056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56d47d-cc9e-4987-afd2-d8a37d4f8918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:13.881921 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56d47d-cc9e-4987-afd2-d8a37d4f8918 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:13.882204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56d47d-cc9e-4987-afd2-d8a37d4f8918 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:13.882479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56d47d-cc9e-4987-afd2-d8a37d4f8918 None admin] PATH_INFO: `/v3/users/7e841fa8a53f40a78d52e4fd5f69603e` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:13.883669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56d47d-cc9e-4987-afd2-d8a37d4f8918 None admin] RBAC: Authorizing `identity:get_user(user_id=7e841fa8a53f40a78d52e4fd5f69603e)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:13.885088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56d47d-cc9e-4987-afd2-d8a37d4f8918 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:13.887354 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 571/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:21:13 2022] GET /identity/v3/users/7e841fa8a53f40a78d52e4fd5f69603e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:13.893215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:13.985966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553619ce-9aff-4303-90a8-9de6d71862ee None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:14.017990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110630b-d723-430b-a1bc-8b58711d6652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:14.018655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110630b-d723-430b-a1bc-8b58711d6652 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:14.018947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110630b-d723-430b-a1bc-8b58711d6652 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:14.019227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110630b-d723-430b-a1bc-8b58711d6652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:14.083386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110630b-d723-430b-a1bc-8b58711d6652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:14.084841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110630b-d723-430b-a1bc-8b58711d6652 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:14.176934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 588/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:21:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:21:14.183417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56d47d-cc9e-4987-afd2-d8a37d4f8918 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:14.275584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56d47d-cc9e-4987-afd2-d8a37d4f8918 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:14.308061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d79ba-1210-4719-b0be-cba9ab4f5196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:14.308897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d79ba-1210-4719-b0be-cba9ab4f5196 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:14.309178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d79ba-1210-4719-b0be-cba9ab4f5196 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:14.309448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d79ba-1210-4719-b0be-cba9ab4f5196 None admin] PATH_INFO: `/v3/projects/9a857c6e39cc464cb99e03167ebbde5e` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:14.310642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d79ba-1210-4719-b0be-cba9ab4f5196 None admin] RBAC: Authorizing `identity:get_project(project_id=9a857c6e39cc464cb99e03167ebbde5e)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:14.312060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d79ba-1210-4719-b0be-cba9ab4f5196 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:14.313709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 572/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:21:14 2022] GET /identity/v3/projects/9a857c6e39cc464cb99e03167ebbde5e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:14.319530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110630b-d723-430b-a1bc-8b58711d6652 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:14.412506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110630b-d723-430b-a1bc-8b58711d6652 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:14.444758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adc154-867e-435e-8a19-b8683f581a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:14.445348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc154-867e-435e-8a19-b8683f581a5c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:14.445639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc154-867e-435e-8a19-b8683f581a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:14.445924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adc154-867e-435e-8a19-b8683f581a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:14.446792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adc154-867e-435e-8a19-b8683f581a5c None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=9a857c6e39cc464cb99e03167ebbde5e, user.id=7e841fa8a53f40a78d52e4fd5f69603e) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:14.447112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adc154-867e-435e-8a19-b8683f581a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:14.449163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adc154-867e-435e-8a19-b8683f581a5c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:14.454759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 589/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:21:14 2022] GET /identity/v3/role_assignments?user.id=7e841fa8a53f40a78d52e4fd5f69603e&scope.project.id=9a857c6e39cc464cb99e03167ebbde5e&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:16.684811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc797d9-fc1c-4b91-a8b9-81c9e0a370d2 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:16.685397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc797d9-fc1c-4b91-a8b9-81c9e0a370d2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:16.685397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc797d9-fc1c-4b91-a8b9-81c9e0a370d2 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:16.686778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 573/1162] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:16.691745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f8a4d-ade3-4748-b9e3-80dffa5b9ccf None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:16.692181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f8a4d-ade3-4748-b9e3-80dffa5b9ccf None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:16.692305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f8a4d-ade3-4748-b9e3-80dffa5b9ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:16.708989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-0a5f8a4d-ade3-4748-b9e3-80dffa5b9ccf None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:16.710154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0a5f8a4d-ade3-4748-b9e3-80dffa5b9ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:16.772144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 590/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:16.793740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc797d9-fc1c-4b91-a8b9-81c9e0a370d2 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:16.889120 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc797d9-fc1c-4b91-a8b9-81c9e0a370d2 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:16.927594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec84b-e1dd-41da-9535-91e7a9c71911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:16.928247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec84b-e1dd-41da-9535-91e7a9c71911 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:16.928534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec84b-e1dd-41da-9535-91e7a9c71911 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:16.928813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec84b-e1dd-41da-9535-91e7a9c71911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:16.991487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ec84b-e1dd-41da-9535-91e7a9c71911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:16.992873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ec84b-e1dd-41da-9535-91e7a9c71911 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:17.085102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 574/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:21:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:21:17.091245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f8a4d-ade3-4748-b9e3-80dffa5b9ccf None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:17.184897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f8a4d-ade3-4748-b9e3-80dffa5b9ccf None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:17.216728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfbfb1-e912-4ba8-8ef0-d676c6dec581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:17.217524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfbfb1-e912-4ba8-8ef0-d676c6dec581 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:17.217812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfbfb1-e912-4ba8-8ef0-d676c6dec581 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:17.218092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfbfb1-e912-4ba8-8ef0-d676c6dec581 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:17.224608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfbfb1-e912-4ba8-8ef0-d676c6dec581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:17.226054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfbfb1-e912-4ba8-8ef0-d676c6dec581 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:17.240879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-f3dfbfb1-e912-4ba8-8ef0-d676c6dec581 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 28 16:21:17.242201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 591/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:21:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:21:17.249059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec84b-e1dd-41da-9535-91e7a9c71911 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:17.341735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec84b-e1dd-41da-9535-91e7a9c71911 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:17.373864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677e720-fd2f-492a-bf33-bc04e9dd4c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:17.374512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e720-fd2f-492a-bf33-bc04e9dd4c53 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:17.374822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e720-fd2f-492a-bf33-bc04e9dd4c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:17.375094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677e720-fd2f-492a-bf33-bc04e9dd4c53 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:17.375805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e720-fd2f-492a-bf33-bc04e9dd4c53 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:17.376108 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e720-fd2f-492a-bf33-bc04e9dd4c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:17.377448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677e720-fd2f-492a-bf33-bc04e9dd4c53 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:17.384313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 575/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Apr 28 16:21:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:19.592894 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051bb7-5f05-47e6-a9db-61728afbed5e None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:19.593463 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051bb7-5f05-47e6-a9db-61728afbed5e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:19.593463 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f051bb7-5f05-47e6-a9db-61728afbed5e None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:19.594841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 592/1167] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:19.599890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2809b-964d-4202-9672-81f9ea395735 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:19.600288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2809b-964d-4202-9672-81f9ea395735 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:19.600455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2809b-964d-4202-9672-81f9ea395735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:19.617088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-edd2809b-964d-4202-9672-81f9ea395735 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:19.618271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-edd2809b-964d-4202-9672-81f9ea395735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:19.680288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 576/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:21:19.703366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051bb7-5f05-47e6-a9db-61728afbed5e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:19.798207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f051bb7-5f05-47e6-a9db-61728afbed5e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:19.833597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f177598-7b96-4ce0-8e8f-88869f3f8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:19.834242 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177598-7b96-4ce0-8e8f-88869f3f8392 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:19.834523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177598-7b96-4ce0-8e8f-88869f3f8392 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:19.834829 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177598-7b96-4ce0-8e8f-88869f3f8392 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:19.835558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f177598-7b96-4ce0-8e8f-88869f3f8392 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:19.836917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f177598-7b96-4ce0-8e8f-88869f3f8392 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:19.935741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 593/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Thu Apr 28 16:21:19 2022] POST /identity/v3/domains => generated 267 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:21:22.181075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a58c5-6be7-4d02-9b99-7308ee44fb97 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:22.181604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a58c5-6be7-4d02-9b99-7308ee44fb97 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:22.181707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a58c5-6be7-4d02-9b99-7308ee44fb97 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:22.183578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 577/1170] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:22.188855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d0c3-d6bb-44ea-8f27-3e99c0d2fa66 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:22.189242 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d0c3-d6bb-44ea-8f27-3e99c0d2fa66 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:22.189421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4d0c3-d6bb-44ea-8f27-3e99c0d2fa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:22.206103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-95f4d0c3-d6bb-44ea-8f27-3e99c0d2fa66 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:22.207331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-95f4d0c3-d6bb-44ea-8f27-3e99c0d2fa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:22.269070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 594/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:22.292141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a58c5-6be7-4d02-9b99-7308ee44fb97 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:22.386127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a58c5-6be7-4d02-9b99-7308ee44fb97 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:22.417960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd380-8308-4e45-9464-8cc08712ffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:22.418825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd380-8308-4e45-9464-8cc08712ffe1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:22.419111 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd380-8308-4e45-9464-8cc08712ffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:22.419388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd380-8308-4e45-9464-8cc08712ffe1 None admin] PATH_INFO: `/v3/domains/7433ef352f0f4780b9e8dc54866c6b2b` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:22.429383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd380-8308-4e45-9464-8cc08712ffe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7433ef352f0f4780b9e8dc54866c6b2b)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:22.430852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd380-8308-4e45-9464-8cc08712ffe1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:22.433026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 578/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Apr 28 16:21:22 2022] GET /identity/v3/domains/7433ef352f0f4780b9e8dc54866c6b2b => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:22.438721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4d0c3-d6bb-44ea-8f27-3e99c0d2fa66 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:22.530192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4d0c3-d6bb-44ea-8f27-3e99c0d2fa66 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:22.562634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0047210-ecb1-4e68-b3f3-3751d928bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:22.563276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0047210-ecb1-4e68-b3f3-3751d928bb75 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:22.563563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0047210-ecb1-4e68-b3f3-3751d928bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:22.563840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0047210-ecb1-4e68-b3f3-3751d928bb75 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:22.564538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0047210-ecb1-4e68-b3f3-3751d928bb75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:22.565948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0047210-ecb1-4e68-b3f3-3751d928bb75 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:22.684537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 595/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:21:22 2022] POST /identity/v3/projects => generated 361 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:21:24.910687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d96e4-6905-4bea-a5df-1340e29c0529 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:24.911244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d96e4-6905-4bea-a5df-1340e29c0529 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:24.911244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d96e4-6905-4bea-a5df-1340e29c0529 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:24.912586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 579/1174] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:24.917752 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fbc44-f7b0-40ee-b738-98a1b5ef2e7c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:24.918171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fbc44-f7b0-40ee-b738-98a1b5ef2e7c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:24.918324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fbc44-f7b0-40ee-b738-98a1b5ef2e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:24.935307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-478fbc44-f7b0-40ee-b738-98a1b5ef2e7c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:24.936478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-478fbc44-f7b0-40ee-b738-98a1b5ef2e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:24.998387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 596/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:25.023125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d96e4-6905-4bea-a5df-1340e29c0529 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:25.117416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d96e4-6905-4bea-a5df-1340e29c0529 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:25.148767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fcf92-183b-4dbe-b8a2-a5eae1ea868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:25.149609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fcf92-183b-4dbe-b8a2-a5eae1ea868a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:25.149886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fcf92-183b-4dbe-b8a2-a5eae1ea868a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:25.150155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fcf92-183b-4dbe-b8a2-a5eae1ea868a None admin] PATH_INFO: `/v3/domains/7433ef352f0f4780b9e8dc54866c6b2b` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:25.151348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fcf92-183b-4dbe-b8a2-a5eae1ea868a None admin] RBAC: Authorizing `identity:get_domain(domain_id=7433ef352f0f4780b9e8dc54866c6b2b)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:25.152760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fcf92-183b-4dbe-b8a2-a5eae1ea868a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:25.154348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 580/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Apr 28 16:21:25 2022] GET /identity/v3/domains/7433ef352f0f4780b9e8dc54866c6b2b => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:25.160044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fbc44-f7b0-40ee-b738-98a1b5ef2e7c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:25.252188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fbc44-f7b0-40ee-b738-98a1b5ef2e7c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:25.283712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51050ccf-a426-4435-aa26-0619deafcacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:25.284365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050ccf-a426-4435-aa26-0619deafcacf None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:25.284645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050ccf-a426-4435-aa26-0619deafcacf None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:25.284919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050ccf-a426-4435-aa26-0619deafcacf None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:25.285624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51050ccf-a426-4435-aa26-0619deafcacf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:25.287160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51050ccf-a426-4435-aa26-0619deafcacf None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:25.367596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 597/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:21:25 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:21:27.615639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fac8a-6b7a-448f-9d8c-85c55bf5a4b2 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:27.616201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fac8a-6b7a-448f-9d8c-85c55bf5a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:27.616201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fac8a-6b7a-448f-9d8c-85c55bf5a4b2 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:27.617633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 581/1178] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:27.623449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3ed3e-67ee-47e4-890d-5b0ab3479a46 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:27.623856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3ed3e-67ee-47e4-890d-5b0ab3479a46 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:27.624009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3ed3e-67ee-47e4-890d-5b0ab3479a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:27.640787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-89a3ed3e-67ee-47e4-890d-5b0ab3479a46 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:27.641961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-89a3ed3e-67ee-47e4-890d-5b0ab3479a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:27.705755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 598/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:27.728556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fac8a-6b7a-448f-9d8c-85c55bf5a4b2 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:27.823857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fac8a-6b7a-448f-9d8c-85c55bf5a4b2 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:27.858114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaadab-dbfb-41f2-9090-80173b7f2c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:27.858928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaadab-dbfb-41f2-9090-80173b7f2c20 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:27.859211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaadab-dbfb-41f2-9090-80173b7f2c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:27.859486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaadab-dbfb-41f2-9090-80173b7f2c20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:27.870074 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaadab-dbfb-41f2-9090-80173b7f2c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:21:27.876894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-0cfaadab-dbfb-41f2-9090-80173b7f2c20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:21:27.878061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 582/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:21:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:21:27.883979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3ed3e-67ee-47e4-890d-5b0ab3479a46 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:27.977332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3ed3e-67ee-47e4-890d-5b0ab3479a46 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:28.008792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:28.009440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:28.009721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:28.010009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:28.010779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:28.011085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:28.012462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:28.020014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 599/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:28.025480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaadab-dbfb-41f2-9090-80173b7f2c20 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:28.118443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaadab-dbfb-41f2-9090-80173b7f2c20 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:28.149392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50d780-ea22-4bc9-9e06-ebb61bb57cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:28.150192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50d780-ea22-4bc9-9e06-ebb61bb57cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:28.150475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50d780-ea22-4bc9-9e06-ebb61bb57cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:28.151291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50d780-ea22-4bc9-9e06-ebb61bb57cb1 None admin] PATH_INFO: `/v3/users/0bf178d4821a492c9dd4db41008ce734` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:28.163458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50d780-ea22-4bc9-9e06-ebb61bb57cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=0bf178d4821a492c9dd4db41008ce734)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:28.164882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50d780-ea22-4bc9-9e06-ebb61bb57cb1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:28.167135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 583/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:21:28 2022] GET /identity/v3/users/0bf178d4821a492c9dd4db41008ce734 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:28.172778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:28.265911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d6b6a-5ee0-42ec-9a7e-9cdb79340df2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:28.297768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df23890-cc72-48a8-bdee-9cd67bfc6795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:28.298406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23890-cc72-48a8-bdee-9cd67bfc6795 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:28.300526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23890-cc72-48a8-bdee-9cd67bfc6795 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:28.300526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23890-cc72-48a8-bdee-9cd67bfc6795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:28.362609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df23890-cc72-48a8-bdee-9cd67bfc6795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:28.364051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df23890-cc72-48a8-bdee-9cd67bfc6795 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:28.455806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 600/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:21:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:21:28.461595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50d780-ea22-4bc9-9e06-ebb61bb57cb1 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:28.552967 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50d780-ea22-4bc9-9e06-ebb61bb57cb1 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:28.584241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c52111-619e-47b2-8e69-65d836fad86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:28.585080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52111-619e-47b2-8e69-65d836fad86d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:28.585365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52111-619e-47b2-8e69-65d836fad86d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:28.585645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52111-619e-47b2-8e69-65d836fad86d None admin] PATH_INFO: `/v3/projects/448ae04296704123a65b41ddcfb261fa` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:28.586836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c52111-619e-47b2-8e69-65d836fad86d None admin] RBAC: Authorizing `identity:get_project(project_id=448ae04296704123a65b41ddcfb261fa)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:28.588802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c52111-619e-47b2-8e69-65d836fad86d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:28.590452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 584/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:21:28 2022] GET /identity/v3/projects/448ae04296704123a65b41ddcfb261fa => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:28.596177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df23890-cc72-48a8-bdee-9cd67bfc6795 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:28.687220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df23890-cc72-48a8-bdee-9cd67bfc6795 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:28.718875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baf966-944f-4c73-856d-a5ff7a627ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:28.719456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf966-944f-4c73-856d-a5ff7a627ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:28.719738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf966-944f-4c73-856d-a5ff7a627ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:28.720014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baf966-944f-4c73-856d-a5ff7a627ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:28.720841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baf966-944f-4c73-856d-a5ff7a627ff5 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=448ae04296704123a65b41ddcfb261fa, user.id=0bf178d4821a492c9dd4db41008ce734) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:28.721150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baf966-944f-4c73-856d-a5ff7a627ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:28.722601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baf966-944f-4c73-856d-a5ff7a627ff5 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:28.727747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 601/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:21:28 2022] GET /identity/v3/role_assignments?user.id=0bf178d4821a492c9dd4db41008ce734&scope.project.id=448ae04296704123a65b41ddcfb261fa&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:30.928098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405867f-de5f-49ba-b71f-507b08e48488 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:30.928646 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405867f-de5f-49ba-b71f-507b08e48488 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:30.928646 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405867f-de5f-49ba-b71f-507b08e48488 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:30.930007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 585/1186] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:30.935818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc687-1a1c-44db-af79-19d2c4b23645 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:30.936255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc687-1a1c-44db-af79-19d2c4b23645 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:30.936375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc687-1a1c-44db-af79-19d2c4b23645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:30.952562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d2bdc687-1a1c-44db-af79-19d2c4b23645 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:30.953738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d2bdc687-1a1c-44db-af79-19d2c4b23645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:31.016396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 602/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:21:31.038759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405867f-de5f-49ba-b71f-507b08e48488 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:31.133773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405867f-de5f-49ba-b71f-507b08e48488 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:31.166098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480e96-7a0e-47bd-aa01-2ffe873271a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:31.167446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480e96-7a0e-47bd-aa01-2ffe873271a6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:31.167728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480e96-7a0e-47bd-aa01-2ffe873271a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:31.168002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480e96-7a0e-47bd-aa01-2ffe873271a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:31.177716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480e96-7a0e-47bd-aa01-2ffe873271a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:21:31.184695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-95480e96-7a0e-47bd-aa01-2ffe873271a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:21:31.185815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 586/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:21:31.191784 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdc687-1a1c-44db-af79-19d2c4b23645 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:31.283920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdc687-1a1c-44db-af79-19d2c4b23645 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:31.315911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:31.316568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:31.316854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:31.317134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:31.317880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:31.318187 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:31.319587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:31.327766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 603/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:31.333545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480e96-7a0e-47bd-aa01-2ffe873271a6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:31.426790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480e96-7a0e-47bd-aa01-2ffe873271a6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:31.458159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de9faa-ba0c-49e2-a696-babd49a203a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:31.458992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de9faa-ba0c-49e2-a696-babd49a203a0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:31.459275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de9faa-ba0c-49e2-a696-babd49a203a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:31.459548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de9faa-ba0c-49e2-a696-babd49a203a0 None admin] PATH_INFO: `/v3/users/0bf178d4821a492c9dd4db41008ce734` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:31.460720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de9faa-ba0c-49e2-a696-babd49a203a0 None admin] RBAC: Authorizing `identity:get_user(user_id=0bf178d4821a492c9dd4db41008ce734)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:31.462150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de9faa-ba0c-49e2-a696-babd49a203a0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:31.464400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 587/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:21:31 2022] GET /identity/v3/users/0bf178d4821a492c9dd4db41008ce734 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:31.470000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:31.563217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aabdae-c3d7-4789-98a4-a50ce29b8941 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:31.595387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daaff1-e6c8-4694-8e07-4edde9288ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:31.596227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daaff1-e6c8-4694-8e07-4edde9288ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:31.596513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daaff1-e6c8-4694-8e07-4edde9288ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:31.596790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daaff1-e6c8-4694-8e07-4edde9288ef4 None admin] PATH_INFO: `/v3/projects/448ae04296704123a65b41ddcfb261fa` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:31.597956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daaff1-e6c8-4694-8e07-4edde9288ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=448ae04296704123a65b41ddcfb261fa)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:31.599394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daaff1-e6c8-4694-8e07-4edde9288ef4 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:31.601045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 604/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:21:31 2022] GET /identity/v3/projects/448ae04296704123a65b41ddcfb261fa => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:31.606639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de9faa-ba0c-49e2-a696-babd49a203a0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:31.699369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de9faa-ba0c-49e2-a696-babd49a203a0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:31.729850 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4badf-a7e6-4ee9-8250-662637db5eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:31.730696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4badf-a7e6-4ee9-8250-662637db5eb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:31.730981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4badf-a7e6-4ee9-8250-662637db5eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:31.731255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4badf-a7e6-4ee9-8250-662637db5eb5 None admin] PATH_INFO: `/v3/projects/448ae04296704123a65b41ddcfb261fa/users/0bf178d4821a492c9dd4db41008ce734/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:31.733189 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4badf-a7e6-4ee9-8250-662637db5eb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=448ae04296704123a65b41ddcfb261fa, user_id=0bf178d4821a492c9dd4db41008ce734, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:31.734659 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4badf-a7e6-4ee9-8250-662637db5eb5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:31.808161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 588/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:21:31 2022] PUT /identity/v3/projects/448ae04296704123a65b41ddcfb261fa/users/0bf178d4821a492c9dd4db41008ce734/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:21:34.000450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342ffd9-95f4-4cb7-add2-f6bd0adcadbb None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:34.000998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342ffd9-95f4-4cb7-add2-f6bd0adcadbb None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:34.000998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342ffd9-95f4-4cb7-add2-f6bd0adcadbb None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:34.002368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 605/1193] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:21:34.007392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4976de-2701-4651-8922-0d2b107fc325 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:34.007763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4976de-2701-4651-8922-0d2b107fc325 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:34.007950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4976de-2701-4651-8922-0d2b107fc325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:34.023983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-af4976de-2701-4651-8922-0d2b107fc325 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:21:34.025146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-af4976de-2701-4651-8922-0d2b107fc325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:21:34.086992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 589/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:21:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:21:34.110857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342ffd9-95f4-4cb7-add2-f6bd0adcadbb None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:34.205363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342ffd9-95f4-4cb7-add2-f6bd0adcadbb None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:34.237329 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb5c4-5264-4996-8087-878dfb9bd4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:34.238110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb5c4-5264-4996-8087-878dfb9bd4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:34.238449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb5c4-5264-4996-8087-878dfb9bd4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:34.238759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb5c4-5264-4996-8087-878dfb9bd4f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:34.248324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbb5c4-5264-4996-8087-878dfb9bd4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:21:34.255313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-6efbb5c4-5264-4996-8087-878dfb9bd4f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:21:34.256420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 606/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:21:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:21:34.262249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4976de-2701-4651-8922-0d2b107fc325 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:34.361324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4976de-2701-4651-8922-0d2b107fc325 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:34.392544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:34.393198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:34.393480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:34.393753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:34.394500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:34.394831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:34.396181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:34.404453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 590/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:34.410344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb5c4-5264-4996-8087-878dfb9bd4f0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:34.504068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb5c4-5264-4996-8087-878dfb9bd4f0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:34.538281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba69692-8e01-45f5-a651-935362171c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:34.539108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba69692-8e01-45f5-a651-935362171c8f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:34.539400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba69692-8e01-45f5-a651-935362171c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:34.539681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba69692-8e01-45f5-a651-935362171c8f None admin] PATH_INFO: `/v3/users/0bf178d4821a492c9dd4db41008ce734` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:34.540872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba69692-8e01-45f5-a651-935362171c8f None admin] RBAC: Authorizing `identity:get_user(user_id=0bf178d4821a492c9dd4db41008ce734)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:34.542335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba69692-8e01-45f5-a651-935362171c8f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:34.543979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 607/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Apr 28 16:21:34 2022] GET /identity/v3/users/0bf178d4821a492c9dd4db41008ce734 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:34.549573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:34.647280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531ac06-03c8-445f-971e-432e0aa73155 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:34.678564 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf02df-8843-4740-a190-de761e7eb100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:34.679225 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf02df-8843-4740-a190-de761e7eb100 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:34.679507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf02df-8843-4740-a190-de761e7eb100 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:34.679777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf02df-8843-4740-a190-de761e7eb100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:34.741022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf02df-8843-4740-a190-de761e7eb100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:34.742451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf02df-8843-4740-a190-de761e7eb100 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:34.834361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 591/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:21:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:21:34.840217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba69692-8e01-45f5-a651-935362171c8f None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:34.936128 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba69692-8e01-45f5-a651-935362171c8f None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:34.969062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b0794-9f0f-4f54-8dca-2f32d390be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:34.969918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b0794-9f0f-4f54-8dca-2f32d390be27 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:34.970204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b0794-9f0f-4f54-8dca-2f32d390be27 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:34.970483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b0794-9f0f-4f54-8dca-2f32d390be27 None admin] PATH_INFO: `/v3/projects/448ae04296704123a65b41ddcfb261fa` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:34.971680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b0794-9f0f-4f54-8dca-2f32d390be27 None admin] RBAC: Authorizing `identity:get_project(project_id=448ae04296704123a65b41ddcfb261fa)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:34.973123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b0794-9f0f-4f54-8dca-2f32d390be27 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:34.974853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 608/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Apr 28 16:21:34 2022] GET /identity/v3/projects/448ae04296704123a65b41ddcfb261fa => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:21:34.980991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf02df-8843-4740-a190-de761e7eb100 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:21:35.074471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf02df-8843-4740-a190-de761e7eb100 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:21:35.106028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1699fe-9250-41f0-b299-d5ba67ae4f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:21:35.106656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1699fe-9250-41f0-b299-d5ba67ae4f41 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:21:35.106941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1699fe-9250-41f0-b299-d5ba67ae4f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:21:35.107217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1699fe-9250-41f0-b299-d5ba67ae4f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:21:35.108049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1699fe-9250-41f0-b299-d5ba67ae4f41 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=448ae04296704123a65b41ddcfb261fa, user.id=0bf178d4821a492c9dd4db41008ce734) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:21:35.108358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1699fe-9250-41f0-b299-d5ba67ae4f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:21:35.109792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1699fe-9250-41f0-b299-d5ba67ae4f41 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:21:35.115396 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 592/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:21:34 2022] GET /identity/v3/role_assignments?user.id=0bf178d4821a492c9dd4db41008ce734&scope.project.id=448ae04296704123a65b41ddcfb261fa&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:22:52.175461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e65a0-5e33-4f2c-b50d-67aabce8e93b None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:52.176029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e65a0-5e33-4f2c-b50d-67aabce8e93b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:52.176029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e65a0-5e33-4f2c-b50d-67aabce8e93b None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:52.177438 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 609/1201] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:22:52.183011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186679-25c9-4f42-bec7-b4d061e84ec7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:52.183446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186679-25c9-4f42-bec7-b4d061e84ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:52.183543 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c186679-25c9-4f42-bec7-b4d061e84ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:52.200483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-4c186679-25c9-4f42-bec7-b4d061e84ec7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:22:52.201669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4c186679-25c9-4f42-bec7-b4d061e84ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:22:52.268289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 593/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:22:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:22:52.294410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e65a0-5e33-4f2c-b50d-67aabce8e93b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:52.411911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e65a0-5e33-4f2c-b50d-67aabce8e93b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:52.443493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:52.444620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:52.444620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:52.444847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:52.455076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:52.456598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:52.473394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:22:52.474731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 610/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:22:52.480714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c186679-25c9-4f42-bec7-b4d061e84ec7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:52.573685 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c186679-25c9-4f42-bec7-b4d061e84ec7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:52.606838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cafd3a-06f8-4d10-8c7f-a1bce951831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:52.607498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafd3a-06f8-4d10-8c7f-a1bce951831f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:52.607786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafd3a-06f8-4d10-8c7f-a1bce951831f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:52.608061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafd3a-06f8-4d10-8c7f-a1bce951831f None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:52.608780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cafd3a-06f8-4d10-8c7f-a1bce951831f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:22:52.609086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cafd3a-06f8-4d10-8c7f-a1bce951831f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:52.610448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cafd3a-06f8-4d10-8c7f-a1bce951831f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:52.622670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 594/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:22:52.628494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:52.732982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821561b-fc08-4e1d-9738-d9c8ee19f6b7 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:52.766103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37a22e-d035-4315-b1ae-70ae63f410d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:52.766799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37a22e-d035-4315-b1ae-70ae63f410d2 None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:52.767085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37a22e-d035-4315-b1ae-70ae63f410d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:52.767365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37a22e-d035-4315-b1ae-70ae63f410d2 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:52.768113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37a22e-d035-4315-b1ae-70ae63f410d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:52.769542 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37a22e-d035-4315-b1ae-70ae63f410d2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:52.850431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 611/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Apr 28 16:22:52 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:22:55.104797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ad3b-eaf4-44eb-88b1-cae4bc410312 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:55.105325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ad3b-eaf4-44eb-88b1-cae4bc410312 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:55.105423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ad3b-eaf4-44eb-88b1-cae4bc410312 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:55.106755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 595/1206] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:22:55.111897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6316-3af1-4106-9884-a94b20445695 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:55.112410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6316-3af1-4106-9884-a94b20445695 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:55.112528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6316-3af1-4106-9884-a94b20445695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:55.129664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-155e6316-3af1-4106-9884-a94b20445695 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:22:55.130899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-155e6316-3af1-4106-9884-a94b20445695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:22:55.194658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 612/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:22:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:22:55.218110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ad3b-eaf4-44eb-88b1-cae4bc410312 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:55.315387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ad3b-eaf4-44eb-88b1-cae4bc410312 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:55.346832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743636-0f34-4490-9176-54a5f0d12481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:55.347662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743636-0f34-4490-9176-54a5f0d12481 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:55.347945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743636-0f34-4490-9176-54a5f0d12481 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:55.348222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743636-0f34-4490-9176-54a5f0d12481 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:55.358790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3743636-0f34-4490-9176-54a5f0d12481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:22:55.365809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-c3743636-0f34-4490-9176-54a5f0d12481 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:22:55.367013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 596/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:22:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:22:55.373655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e6316-3af1-4106-9884-a94b20445695 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:55.467762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e6316-3af1-4106-9884-a94b20445695 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:55.500672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:55.501334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:55.501622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:55.501894 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:55.502659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:22:55.502969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:55.504336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:55.511970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 613/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:22:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:22:55.517638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743636-0f34-4490-9176-54a5f0d12481 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:55.612782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3743636-0f34-4490-9176-54a5f0d12481 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:55.646081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:55.646902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:55.647187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:55.647462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:55.657725 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:55.659211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:55.676297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:22:55.677465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 597/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:22:55.683402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:55.778140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f88600-6d3a-4a1e-bb45-630d483f7835 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:55.811672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:55.812326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:55.812616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:55.812891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:55.813607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:22:55.813912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:55.815300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:55.826223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 614/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:22:55.831891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:55.927309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030c6b-b725-453b-8016-67dd8acf7350 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:55.959372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:55.960169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:55.960455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:55.960731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:55.968164 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:55.969593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:55.983984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 16:22:55.985187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 598/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:22:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:22:55.991035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:56.088677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e41ec-dded-47e2-a3d8-d6d789b93e33 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:56.121427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:56.122285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:56.122382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:56.122657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:56.123491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:22:56.123801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:56.125243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:56.141487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 615/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Apr 28 16:22:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:22:56.147239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:56.245935 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c169c6b-8d7a-4f5d-8906-90296067c5d2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:56.280035 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821a48e-b722-4016-b13e-4c2216f6b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:56.280685 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821a48e-b722-4016-b13e-4c2216f6b871 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:56.280973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821a48e-b722-4016-b13e-4c2216f6b871 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:56.281252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821a48e-b722-4016-b13e-4c2216f6b871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:56.345308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821a48e-b722-4016-b13e-4c2216f6b871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:56.346776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821a48e-b722-4016-b13e-4c2216f6b871 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:56.441437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 599/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:22:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:22:56.447364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:56.543775 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3e028-6632-429f-a0e9-80a784286662 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:56.575936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:56.576867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:56.577154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:56.577424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:56.587619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:56.589096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:56.606124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:22:56.607343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 616/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:22:56.613013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821a48e-b722-4016-b13e-4c2216f6b871 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:56.705512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821a48e-b722-4016-b13e-4c2216f6b871 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:56.738097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:56.738785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:56.739072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:56.739349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:56.740067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:22:56.740374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:56.741743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:56.752570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 600/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:22:56.758710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:56.853612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e6096-9a07-4b78-8f7b-d43b834e8359 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:56.885935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:56.886749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:56.887037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:56.887318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:56.893799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:56.895289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:56.908690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:22:56.913581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 617/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:22:56.915874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:57.011136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff29af-b1d6-4b96-ad85-5a556efcbfda None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:57.045381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430377fe-0a59-4aef-8919-c5afa92a049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:57.046045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430377fe-0a59-4aef-8919-c5afa92a049e None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:57.046326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430377fe-0a59-4aef-8919-c5afa92a049e None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:57.047053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430377fe-0a59-4aef-8919-c5afa92a049e None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:57.047424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430377fe-0a59-4aef-8919-c5afa92a049e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:22:57.047728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430377fe-0a59-4aef-8919-c5afa92a049e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:57.049419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430377fe-0a59-4aef-8919-c5afa92a049e None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:57.063461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 601/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:22:57.069551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:57.167288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bec49-783b-465e-b2b6-d9dd56e85af3 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:57.200483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434588f-698a-4b48-97d4-371deb8231ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:57.201128 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434588f-698a-4b48-97d4-371deb8231ad None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:57.201410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434588f-698a-4b48-97d4-371deb8231ad None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:57.201684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434588f-698a-4b48-97d4-371deb8231ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:57.202579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434588f-698a-4b48-97d4-371deb8231ad None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=ded012db549b45669a4ffcdd988b55ff) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:22:57.202895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434588f-698a-4b48-97d4-371deb8231ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:57.204321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434588f-698a-4b48-97d4-371deb8231ad None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:57.209554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 618/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:22:57 2022] GET /identity/v3/role_assignments?user.id=ded012db549b45669a4ffcdd988b55ff&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:22:59.406226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db35ed-7959-4476-b585-b35e82e30992 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:59.406783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db35ed-7959-4476-b585-b35e82e30992 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:59.406875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db35ed-7959-4476-b585-b35e82e30992 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:59.408186 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 602/1220] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:22:59.413549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56309a-aae3-4a37-afc0-c67f95614f3a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:59.413951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56309a-aae3-4a37-afc0-c67f95614f3a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:59.414174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56309a-aae3-4a37-afc0-c67f95614f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:59.431487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1e56309a-aae3-4a37-afc0-c67f95614f3a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:22:59.432666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1e56309a-aae3-4a37-afc0-c67f95614f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:22:59.496171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 619/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:22:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:22:59.518976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db35ed-7959-4476-b585-b35e82e30992 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:59.616080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db35ed-7959-4476-b585-b35e82e30992 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:59.647913 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294057fa-d007-4913-921a-f45702b424e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:59.648778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294057fa-d007-4913-921a-f45702b424e7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:59.649075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294057fa-d007-4913-921a-f45702b424e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:59.649348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294057fa-d007-4913-921a-f45702b424e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:59.659716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294057fa-d007-4913-921a-f45702b424e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:22:59.667568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-294057fa-d007-4913-921a-f45702b424e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:22:59.670457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 603/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:22:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:22:59.675287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56309a-aae3-4a37-afc0-c67f95614f3a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:59.768902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56309a-aae3-4a37-afc0-c67f95614f3a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:59.801268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:59.802202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:59.802202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:59.802474 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:59.803252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] RBAC: Adding query filter params (name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:22:59.803561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:59.804935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:59.812608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 620/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:22:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:22:59.818326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294057fa-d007-4913-921a-f45702b424e7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:22:59.913200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294057fa-d007-4913-921a-f45702b424e7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:22:59.944701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:22:59.945486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:22:59.945772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:22:59.946088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:22:59.956540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:22:59.957971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:22:59.974583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:22:59.975748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 604/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:22:59.981699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:00.077757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574505b-4fb2-4c33-aaba-4499bcd56058 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:00.109887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:00.110563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:00.110867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:00.111153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:00.111878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:00.112190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:00.113558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:00.124939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 621/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:00.131487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:00.230733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254521eb-1df4-4120-9416-26c78712aff6 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:00.264167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:00.264970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:00.265257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:00.265635 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] PATH_INFO: `/v3/users/placement` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:00.273044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:00.274569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:00.287830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 16:23:00.289013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 605/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:00.294918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:00.389864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b81706-ed5a-450f-b98a-fa13bda4ef11 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:00.421590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:00.422288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:00.422604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:00.422886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:00.423719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:00.424287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:00.425721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:00.442499 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 622/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Apr 28 16:23:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:00.448853 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:00.545449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f0c94-2936-45d2-8c9b-78e0c656a2be None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:00.577575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:00.578364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:00.578684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:00.578966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:00.589628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:00.591116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:00.606884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:00.608053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 606/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:00.613723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:00.709368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8ae0d-f244-4048-874a-dba0d8bddeff None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:00.742639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:00.743341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:00.743624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:00.743909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:00.744629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:00.744933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:00.746359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:00.757134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 623/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:00.763773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:00.858319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d07c3-2f91-473b-9d00-ef3d4d0399cc None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:00.890269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:00.891255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:00.891535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:00.891809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:00.898384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:00.900627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:00.914142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:23:00.915394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 607/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:23:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:00.921126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:01.017608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba37209-bd89-4527-b0fb-069940b141b1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:01.049479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4a5d4-5f89-42e8-9eed-8a9341637ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:01.050167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4a5d4-5f89-42e8-9eed-8a9341637ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:01.050426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4a5d4-5f89-42e8-9eed-8a9341637ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:01.050732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4a5d4-5f89-42e8-9eed-8a9341637ec7 None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:01.051525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4a5d4-5f89-42e8-9eed-8a9341637ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:01.051836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4a5d4-5f89-42e8-9eed-8a9341637ec7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:01.053276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4a5d4-5f89-42e8-9eed-8a9341637ec7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:01.065443 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 624/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:01.071378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:01.167693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f50b2-74ad-4b30-a4c3-3d2917e3594a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:01.201988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b985c-9678-4986-8d27-f3da9c6061f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:01.202958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b985c-9678-4986-8d27-f3da9c6061f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:01.203243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b985c-9678-4986-8d27-f3da9c6061f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:01.203521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b985c-9678-4986-8d27-f3da9c6061f5 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/ded012db549b45669a4ffcdd988b55ff/roles/b9f6881066644547b4a6bbe662963ab1` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:01.217426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b985c-9678-4986-8d27-f3da9c6061f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=ded012db549b45669a4ffcdd988b55ff, role_id=b9f6881066644547b4a6bbe662963ab1)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:01.222312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b985c-9678-4986-8d27-f3da9c6061f5 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:01.285753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 608/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:23:01 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/ded012db549b45669a4ffcdd988b55ff/roles/b9f6881066644547b4a6bbe662963ab1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:23:03.493666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11747bd-f73e-4499-81cf-1e9ece993ff5 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:03.494216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11747bd-f73e-4499-81cf-1e9ece993ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:03.494216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11747bd-f73e-4499-81cf-1e9ece993ff5 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:03.495661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 625/1233] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:23:03.500974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00f44b-f3e4-4da4-b602-54c899d54c51 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:03.501374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00f44b-f3e4-4da4-b602-54c899d54c51 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:03.501585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00f44b-f3e4-4da4-b602-54c899d54c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:03.517734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7a00f44b-f3e4-4da4-b602-54c899d54c51 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:23:03.519057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7a00f44b-f3e4-4da4-b602-54c899d54c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:23:03.582245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 609/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:23:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:23:03.605702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11747bd-f73e-4499-81cf-1e9ece993ff5 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:03.706087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11747bd-f73e-4499-81cf-1e9ece993ff5 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:03.743293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149577a8-d90b-448d-a468-bed4ae7a2503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:03.744143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149577a8-d90b-448d-a468-bed4ae7a2503 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:03.744379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149577a8-d90b-448d-a468-bed4ae7a2503 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:03.744656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149577a8-d90b-448d-a468-bed4ae7a2503 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:03.754501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149577a8-d90b-448d-a468-bed4ae7a2503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:23:03.761961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-149577a8-d90b-448d-a468-bed4ae7a2503 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 28 16:23:03.763184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 626/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Apr 28 16:23:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:03.769172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00f44b-f3e4-4da4-b602-54c899d54c51 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:03.862947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00f44b-f3e4-4da4-b602-54c899d54c51 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:03.895324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:03.895992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:03.896279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:03.896575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:03.897309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] RBAC: Adding query filter params (name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:03.897616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:03.899009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:03.907696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 610/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Apr 28 16:23:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:03.913466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149577a8-d90b-448d-a468-bed4ae7a2503 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:04.008564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149577a8-d90b-448d-a468-bed4ae7a2503 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:04.041452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:04.042261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:04.042562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:04.042846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:04.060559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:04.062038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:04.083390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:04.085053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 627/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:04.090726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:04.185594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b5a9-bb65-4eb2-88f8-7e57a4b0eece None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:04.218138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:04.218828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:04.219115 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:04.219388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:04.220136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:04.220437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:04.221844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:04.232654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 611/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:04.238581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:04.337741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31e940-869b-4c30-b790-0803d8bc0ca2 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:04.371678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:04.372478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:04.372762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:04.373032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] PATH_INFO: `/v3/users/placement` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:04.380247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:04.381682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:04.395097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 16:23:04.396317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 628/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:04.402268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:04.498206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4a1b2-aa94-40e5-b573-5167fb259549 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:04.529026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:04.529695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:04.529977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:04.530272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:04.531127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:04.531435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:04.532859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:04.549774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 612/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Apr 28 16:23:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:04.555470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:04.651822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e30cea-fb7b-46ea-be55-bd5f21208cda None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:04.684635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2090f-ae58-46e7-9ae4-b480fd08bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:04.685279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2090f-ae58-46e7-9ae4-b480fd08bf43 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:04.685565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2090f-ae58-46e7-9ae4-b480fd08bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:04.685844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2090f-ae58-46e7-9ae4-b480fd08bf43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:04.750496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2090f-ae58-46e7-9ae4-b480fd08bf43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:04.751973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2090f-ae58-46e7-9ae4-b480fd08bf43 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:04.845186 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 629/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:23:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:23:04.850906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:04.944665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a48e6e-4887-4c14-a290-3bd7ced3b2d7 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:04.977123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:04.977941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:04.978222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:04.978526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:04.988094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:04.989530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:05.006280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:05.007557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 613/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:05.013785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2090f-ae58-46e7-9ae4-b480fd08bf43 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:05.108994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2090f-ae58-46e7-9ae4-b480fd08bf43 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:05.140924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:05.141569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:05.141852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:05.142129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:05.142876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:05.143184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:05.144543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:05.155291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 630/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:05.160943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:05.256972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daedcc-6490-408e-a7a8-e3dd3f75de5c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:05.288381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:05.289165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:05.289459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:05.289738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:05.296695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:05.301930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:05.311902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:23:05.313102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 614/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:23:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:05.318970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:05.419843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bc172-35f0-4a93-9c89-2e8c36596a85 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:05.451781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29f602-c6da-4354-9dfe-ead0ac8bbabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:05.452440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29f602-c6da-4354-9dfe-ead0ac8bbabe None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:05.452726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29f602-c6da-4354-9dfe-ead0ac8bbabe None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:05.453006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29f602-c6da-4354-9dfe-ead0ac8bbabe None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:05.453796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29f602-c6da-4354-9dfe-ead0ac8bbabe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:05.454108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29f602-c6da-4354-9dfe-ead0ac8bbabe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:05.455580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29f602-c6da-4354-9dfe-ead0ac8bbabe None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:05.467731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 631/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:23:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:05.473834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:05.569919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bba66-0936-49db-b685-dd8146f8420a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:05.601811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b87a2-b699-4fe7-8b59-3d45f3ed637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:05.602458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b87a2-b699-4fe7-8b59-3d45f3ed637d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:05.603392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b87a2-b699-4fe7-8b59-3d45f3ed637d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:05.603671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b87a2-b699-4fe7-8b59-3d45f3ed637d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:05.604557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b87a2-b699-4fe7-8b59-3d45f3ed637d None admin] RBAC: Adding query filter params (role.id=b9f6881066644547b4a6bbe662963ab1, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=ded012db549b45669a4ffcdd988b55ff) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:05.604866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b87a2-b699-4fe7-8b59-3d45f3ed637d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:05.606295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b87a2-b699-4fe7-8b59-3d45f3ed637d None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:05.611879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 615/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:23:05 2022] GET /identity/v3/role_assignments?user.id=ded012db549b45669a4ffcdd988b55ff&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=b9f6881066644547b4a6bbe662963ab1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:07.948598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407ad5-9a42-4768-a3dc-2035b10df064 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:07.949174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407ad5-9a42-4768-a3dc-2035b10df064 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:07.949174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407ad5-9a42-4768-a3dc-2035b10df064 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:07.950519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 632/1247] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:23:07.955674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf22d4-adb5-469b-9b5c-3962f1a327a1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:07.956081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf22d4-adb5-469b-9b5c-3962f1a327a1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:07.956238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf22d4-adb5-469b-9b5c-3962f1a327a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:07.973387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5edf22d4-adb5-469b-9b5c-3962f1a327a1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:23:07.974609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5edf22d4-adb5-469b-9b5c-3962f1a327a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:23:08.046662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 616/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:23:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:23:08.070510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407ad5-9a42-4768-a3dc-2035b10df064 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:08.167908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407ad5-9a42-4768-a3dc-2035b10df064 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:08.200521 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7bf6-f3f8-4c82-a67e-fd6fd81a257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:08.201247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7bf6-f3f8-4c82-a67e-fd6fd81a257d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:08.201533 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7bf6-f3f8-4c82-a67e-fd6fd81a257d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:08.201811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da7bf6-f3f8-4c82-a67e-fd6fd81a257d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:08.211457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da7bf6-f3f8-4c82-a67e-fd6fd81a257d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:23:08.218442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-69da7bf6-f3f8-4c82-a67e-fd6fd81a257d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:23:08.219640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 633/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:23:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:08.225686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf22d4-adb5-469b-9b5c-3962f1a327a1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:08.321097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf22d4-adb5-469b-9b5c-3962f1a327a1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:08.352291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:08.353491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:08.353770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:08.354040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:08.354809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:08.355114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:08.356483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:08.364103 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 617/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:23:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:08.370412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7bf6-f3f8-4c82-a67e-fd6fd81a257d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:08.467009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da7bf6-f3f8-4c82-a67e-fd6fd81a257d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:08.498880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:08.499693 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:08.500004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:08.500260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:08.512179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:08.513642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:08.529530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:08.530873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 634/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:08.536575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:08.630571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556b080-3a97-4313-9b28-c03791736a44 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:08.662371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:08.663055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:08.663344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:08.663630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:08.664355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:08.664665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:08.666069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:08.677611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 618/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:08.683857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:08.780078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d100c4-2df3-4b48-80cb-302d58679e25 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:08.812742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:08.813536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:08.815242 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:08.815242 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:08.821228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:08.822741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:08.835940 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 16:23:08.838248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 635/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:08.843032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:08.937211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc35b2-2111-46e8-bde5-6c56e6bab775 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:08.970161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:08.970942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:08.971216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:08.971497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:08.972348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:08.972682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:08.974116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:08.990611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 619/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Apr 28 16:23:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:08.996315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:09.098675 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75df6c-3602-4a81-a87b-c73e25efb038 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:09.130028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c49cd-188e-438a-8d77-cb2776af8190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:09.130759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c49cd-188e-438a-8d77-cb2776af8190 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:09.131046 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c49cd-188e-438a-8d77-cb2776af8190 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:09.131325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c49cd-188e-438a-8d77-cb2776af8190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:09.195284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c49cd-188e-438a-8d77-cb2776af8190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:09.197400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c49cd-188e-438a-8d77-cb2776af8190 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:09.289632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 636/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:23:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 28 16:23:09.295498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:09.390311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076f22e-7cac-4f19-a024-646ae7c379cc None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:09.422475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:09.423309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:09.423592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:09.424122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:09.434254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:09.435750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:09.453264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:09.454428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 620/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:09.460252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c49cd-188e-438a-8d77-cb2776af8190 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:09.554605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c49cd-188e-438a-8d77-cb2776af8190 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:09.587507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:09.588155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:09.588436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:09.588712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:09.589426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:09.589737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:09.591277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:09.602063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 637/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:09.608245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:09.704106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e71af6-a3a6-4da5-8df4-204be0a1920c None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:09.735647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:09.736437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:09.736721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:09.736994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:09.743977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:09.745421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:09.758128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:23:09.759343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 621/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:23:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:09.765195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:09.860168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0414f24-65fe-405b-846a-e997b6d7084d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:09.891845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f4ffd-00f4-49b2-a822-aa6cbacae40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:09.892495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f4ffd-00f4-49b2-a822-aa6cbacae40c None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:09.892778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f4ffd-00f4-49b2-a822-aa6cbacae40c None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:09.893056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f4ffd-00f4-49b2-a822-aa6cbacae40c None admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:09.893839 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f4ffd-00f4-49b2-a822-aa6cbacae40c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:09.894218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f4ffd-00f4-49b2-a822-aa6cbacae40c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:09.895672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f4ffd-00f4-49b2-a822-aa6cbacae40c None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:09.907589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 638/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:23:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:23:09.913583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:10.008201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366972b-faec-4916-821d-2224d9df6cea None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:10.039524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eac23f-b8f8-4718-a502-d26fc956f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:10.040720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eac23f-b8f8-4718-a502-d26fc956f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:10.041001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eac23f-b8f8-4718-a502-d26fc956f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:10.041274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eac23f-b8f8-4718-a502-d26fc956f8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:10.042111 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eac23f-b8f8-4718-a502-d26fc956f8f6 None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=ded012db549b45669a4ffcdd988b55ff) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:10.042422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eac23f-b8f8-4718-a502-d26fc956f8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:10.043912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eac23f-b8f8-4718-a502-d26fc956f8f6 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:10.049654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 622/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:23:09 2022] GET /identity/v3/role_assignments?user.id=ded012db549b45669a4ffcdd988b55ff&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:12.253614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77bdb2-0071-476f-85ea-21049e75b491 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:12.254166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77bdb2-0071-476f-85ea-21049e75b491 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:12.254166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77bdb2-0071-476f-85ea-21049e75b491 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:12.255591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 639/1261] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:23:12.261651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80496f-97eb-4a95-9a06-61047052e7e6 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:12.262075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80496f-97eb-4a95-9a06-61047052e7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:12.262207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80496f-97eb-4a95-9a06-61047052e7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:12.278686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ae80496f-97eb-4a95-9a06-61047052e7e6 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:23:12.279866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ae80496f-97eb-4a95-9a06-61047052e7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:23:12.343919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 623/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:23:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:23:12.366373 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77bdb2-0071-476f-85ea-21049e75b491 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:12.462790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77bdb2-0071-476f-85ea-21049e75b491 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:12.495356 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb7b4-c134-4735-88bb-e27ec882d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:12.496354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb7b4-c134-4735-88bb-e27ec882d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:12.496638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb7b4-c134-4735-88bb-e27ec882d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:12.496913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeb7b4-c134-4735-88bb-e27ec882d5e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:12.506660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfeb7b4-c134-4735-88bb-e27ec882d5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:23:12.514339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-7bfeb7b4-c134-4735-88bb-e27ec882d5e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:23:12.515533 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 640/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:23:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:12.521704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80496f-97eb-4a95-9a06-61047052e7e6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:12.614857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80496f-97eb-4a95-9a06-61047052e7e6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:12.647322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:12.647983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:12.648270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:12.648548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:12.649315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:12.650211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:12.651608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:12.659371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 624/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:23:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:12.665231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb7b4-c134-4735-88bb-e27ec882d5e4 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:12.762550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeb7b4-c134-4735-88bb-e27ec882d5e4 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:12.794868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:12.795650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:12.795947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:12.796205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:12.806736 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:12.808195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:12.824845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:12.826015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 641/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:12.831998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:12.927474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694ed3-d967-43e3-bf83-0834ba44591f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:12.959983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:12.960652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:12.960940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:12.961221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:12.961982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:12.962284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:12.963680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:12.975022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 625/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:12.980794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:13.079553 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cdb0a-e169-4bd4-b5d0-c94d8ee9942d None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:13.111551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:13.112399 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:13.112689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:13.112974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:13.120713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:13.122162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:13.136235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 16:23:13.137433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 642/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:13.143328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:13.238384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15fcc1-7501-422d-a0d3-cafa585e53f2 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:13.271205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:13.271868 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:13.272155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:13.272432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:13.273362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:13.273671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:13.275253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:13.292277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 626/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Apr 28 16:23:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:13.298165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:13.401390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaed5c-0eab-4e26-8f08-d4c1c9941cb1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:13.435125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:13.435912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:13.436198 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:13.436474 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:13.447314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:13.448840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:13.464883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:13.466125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 643/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:13.471885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:13.565065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7017-cc85-4f6e-82be-2670faed0fdb None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:13.597361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:13.598021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:13.598305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:13.598615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:13.599339 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:13.599646 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:13.601005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:13.612357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 627/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:13.618033 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:13.721893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaf964-3b47-4208-a20b-0eb77777e5f1 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:13.755079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:13.755875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:13.756163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:13.756436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:13.762892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:13.764337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:13.777957 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:23:13.779132 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 644/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:13.784997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:13.881552 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4c532-e41f-4a89-8cfa-76ef17a7bf4f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:13.913028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd698b-3dfb-4483-a276-4da86d6d76ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:13.913677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd698b-3dfb-4483-a276-4da86d6d76ba None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:13.913996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd698b-3dfb-4483-a276-4da86d6d76ba None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:13.914291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd698b-3dfb-4483-a276-4da86d6d76ba None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:13.915744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd698b-3dfb-4483-a276-4da86d6d76ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:13.916051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd698b-3dfb-4483-a276-4da86d6d76ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:13.917495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd698b-3dfb-4483-a276-4da86d6d76ba None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:13.929077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 628/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:13.935131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:14.040566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5088e1-c2ec-4586-a841-4895890ee52a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:14.077019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446b36-1028-44da-9999-407a5c35fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:14.077916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446b36-1028-44da-9999-407a5c35fe42 None admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:14.078203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446b36-1028-44da-9999-407a5c35fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:14.078482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446b36-1028-44da-9999-407a5c35fe42 None admin] PATH_INFO: `/v3/projects/537376d891e2442ba8b85062f564cbb5/users/ded012db549b45669a4ffcdd988b55ff/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:14.080539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446b36-1028-44da-9999-407a5c35fe42 None admin] RBAC: Authorizing `identity:create_grant(project_id=537376d891e2442ba8b85062f564cbb5, user_id=ded012db549b45669a4ffcdd988b55ff, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:14.081975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446b36-1028-44da-9999-407a5c35fe42 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:14.244789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 645/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Apr 28 16:23:13 2022] PUT /identity/v3/projects/537376d891e2442ba8b85062f564cbb5/users/ded012db549b45669a4ffcdd988b55ff/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:23:16.454167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c28b-a443-46d0-ba4b-c1e481f03555 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:16.454734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c28b-a443-46d0-ba4b-c1e481f03555 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:16.454829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c28b-a443-46d0-ba4b-c1e481f03555 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:16.456135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 629/1274] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:23:16.461608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89368b-f0ff-4a9d-8044-ad7a23edde2c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:16.462027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89368b-f0ff-4a9d-8044-ad7a23edde2c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:16.462178 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89368b-f0ff-4a9d-8044-ad7a23edde2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:16.478958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-fe89368b-f0ff-4a9d-8044-ad7a23edde2c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:23:16.480151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fe89368b-f0ff-4a9d-8044-ad7a23edde2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:23:16.543879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 646/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:23:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:23:16.567457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142c28b-a443-46d0-ba4b-c1e481f03555 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:16.678900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142c28b-a443-46d0-ba4b-c1e481f03555 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:16.711403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79104d5-5691-4acb-b323-3259d1a9d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:16.712627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79104d5-5691-4acb-b323-3259d1a9d05d None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:16.712909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79104d5-5691-4acb-b323-3259d1a9d05d None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:16.713183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79104d5-5691-4acb-b323-3259d1a9d05d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:16.722965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79104d5-5691-4acb-b323-3259d1a9d05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 28 16:23:16.730612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-c79104d5-5691-4acb-b323-3259d1a9d05d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 28 16:23:16.731814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 630/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Apr 28 16:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:16.737836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89368b-f0ff-4a9d-8044-ad7a23edde2c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:16.832453 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89368b-f0ff-4a9d-8044-ad7a23edde2c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:16.865828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:16.866485 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:16.866796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:16.867134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:16.867946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:16.868294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:16.869661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:16.877589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 647/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Apr 28 16:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:16.883373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79104d5-5691-4acb-b323-3259d1a9d05d None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:16.979841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79104d5-5691-4acb-b323-3259d1a9d05d None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:17.013764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:17.014609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:17.014896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:17.015474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:17.028086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:17.029546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:17.045900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:17.047191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 631/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:17.053130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:17.149154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b133e4d-a778-4ced-b51e-bc384cf8dbdb None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:17.181402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:17.182084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:17.182366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:17.182670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:17.183387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:17.183693 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:17.185044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:17.197728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 648/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:17.203194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:17.307622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b04fd-c31f-44a7-b067-25ca754f359a None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:17.343077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:17.343904 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:17.344190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:17.344467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:17.353099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:17.354619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:17.369595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 28 16:23:17.370921 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 632/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:17.376941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:17.479811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c92a0-71ae-473e-8315-126d4692556e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:17.516467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:17.517210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:17.517498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:17.517773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:17.518669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:17.518982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:17.520430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:17.543370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 649/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Apr 28 16:23:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:17.544563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:17.644845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba80d80-66d4-4621-ac6f-e9ded51185a0 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:17.677437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a0ef-457f-4664-b777-8384125cb065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:17.678147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a0ef-457f-4664-b777-8384125cb065 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:17.678473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a0ef-457f-4664-b777-8384125cb065 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:17.678779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174a0ef-457f-4664-b777-8384125cb065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:17.744397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a0ef-457f-4664-b777-8384125cb065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:17.745839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174a0ef-457f-4664-b777-8384125cb065 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:17.839752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 633/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Apr 28 16:23:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 28 16:23:17.845587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:17.940404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60424653-6438-4da7-9d8f-b767eb1deb7a None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:17.973658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:17.974455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:17.974771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:17.975055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:17.984782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:17.986233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:18.003389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 28 16:23:18.004622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 650/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 28 16:23:18.011270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a0ef-457f-4664-b777-8384125cb065 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:18.109264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174a0ef-457f-4664-b777-8384125cb065 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:18.140829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:18.141488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:18.141778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:18.142054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:18.142810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:18.143119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:18.144494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:18.155658 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 634/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Apr 28 16:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:18.161386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:18.255440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90671dfd-edb3-4876-93c0-d5d7dc6f4ac0 None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:18.287653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:18.288429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:18.288714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:18.288990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:18.295379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:18.296812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:18.310326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING keystone.server.flask.application [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 28 16:23:18.312610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 651/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Apr 28 16:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:18.317510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:18.414894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0068df4-ab07-4007-83cb-62fa97541b5f None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:18.447275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd7d08-ef63-468f-89b9-24a96c163a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:18.447927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd7d08-ef63-468f-89b9-24a96c163a96 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:18.448209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd7d08-ef63-468f-89b9-24a96c163a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:18.448482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd7d08-ef63-468f-89b9-24a96c163a96 None admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:18.449276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd7d08-ef63-468f-89b9-24a96c163a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:18.449585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd7d08-ef63-468f-89b9-24a96c163a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:18.451102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd7d08-ef63-468f-89b9-24a96c163a96 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:18.462618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 635/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Apr 28 16:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:18.468713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:18.563662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518a748-4b79-4e5c-9f09-bbc1c65cc1cf None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:18.595496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee21ad2-d7bf-4466-9332-b61e78ca8d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:18.596207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21ad2-d7bf-4466-9332-b61e78ca8d0f None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:18.596494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21ad2-d7bf-4466-9332-b61e78ca8d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:18.596792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21ad2-d7bf-4466-9332-b61e78ca8d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:18.597608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21ad2-d7bf-4466-9332-b61e78ca8d0f None admin] RBAC: Adding query filter params (role.id=a21c72e160dd47dd8fd580bc6794a84c, scope.project.id=537376d891e2442ba8b85062f564cbb5, user.id=ded012db549b45669a4ffcdd988b55ff) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:18.597926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21ad2-d7bf-4466-9332-b61e78ca8d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:18.599396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21ad2-d7bf-4466-9332-b61e78ca8d0f None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:18.605596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 652/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Apr 28 16:23:18 2022] GET /identity/v3/role_assignments?user.id=ded012db549b45669a4ffcdd988b55ff&scope.project.id=537376d891e2442ba8b85062f564cbb5&role.id=a21c72e160dd47dd8fd580bc6794a84c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:20.893451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1d44-a279-428a-abd1-ad73d2f96c03 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:20.893998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1d44-a279-428a-abd1-ad73d2f96c03 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:20.893998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d1d44-a279-428a-abd1-ad73d2f96c03 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:20.895449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 636/1288] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:23:20.900751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9cb44-6cc5-40ad-b913-757f4480f001 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:20.901226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9cb44-6cc5-40ad-b913-757f4480f001 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:20.901307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9cb44-6cc5-40ad-b913-757f4480f001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:20.918794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-26e9cb44-6cc5-40ad-b913-757f4480f001 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:23:20.919991 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-26e9cb44-6cc5-40ad-b913-757f4480f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:23:20.984668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 653/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:23:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:23:21.007509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1d44-a279-428a-abd1-ad73d2f96c03 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:21.106104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d1d44-a279-428a-abd1-ad73d2f96c03 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:21.138687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:21.139486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:21.139776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:21.140056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:21.140717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:21.142102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:21.153426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 28 16:23:21.154590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 637/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:23:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:21.160764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9cb44-6cc5-40ad-b913-757f4480f001 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:21.255078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9cb44-6cc5-40ad-b913-757f4480f001 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:21.287551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f832227-ed6a-4c61-b95f-e5d86a361a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:21.288199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832227-ed6a-4c61-b95f-e5d86a361a0e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:21.288483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832227-ed6a-4c61-b95f-e5d86a361a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:21.288757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832227-ed6a-4c61-b95f-e5d86a361a0e None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:21.289455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f832227-ed6a-4c61-b95f-e5d86a361a0e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:21.289813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f832227-ed6a-4c61-b95f-e5d86a361a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:21.291763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f832227-ed6a-4c61-b95f-e5d86a361a0e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:21.301328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 654/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Apr 28 16:23:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:21.302596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:21.396059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d2e65-661e-4061-a0c9-1abff0d23529 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:21.431532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b6ab3-6a2e-427c-b3ee-a5771dd457ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:21.432129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b6ab3-6a2e-427c-b3ee-a5771dd457ce None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:21.432418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b6ab3-6a2e-427c-b3ee-a5771dd457ce None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:21.432699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b6ab3-6a2e-427c-b3ee-a5771dd457ce None admin] PATH_INFO: `/v3/services` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:21.433417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b6ab3-6a2e-427c-b3ee-a5771dd457ce None admin] RBAC: Adding query filter params (type=placement) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:21.433734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b6ab3-6a2e-427c-b3ee-a5771dd457ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:21.435142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b6ab3-6a2e-427c-b3ee-a5771dd457ce None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:21.439619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 638/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Apr 28 16:23:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:23.648608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d088cb-74e7-4c63-a6c6-8d0335e029f8 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:23.649137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d088cb-74e7-4c63-a6c6-8d0335e029f8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:23.649763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d088cb-74e7-4c63-a6c6-8d0335e029f8 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:23.651135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 655/1293] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:23:23.656177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092ca2-5ebc-4b1f-813b-4d32480cdfc1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:23.656616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092ca2-5ebc-4b1f-813b-4d32480cdfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:23.656726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd092ca2-5ebc-4b1f-813b-4d32480cdfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:23.673534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-cd092ca2-5ebc-4b1f-813b-4d32480cdfc1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:23:23.675004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-cd092ca2-5ebc-4b1f-813b-4d32480cdfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:23:23.738228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 639/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:23:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 28 16:23:23.760941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d088cb-74e7-4c63-a6c6-8d0335e029f8 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:23.856560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d088cb-74e7-4c63-a6c6-8d0335e029f8 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:23.888949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbf94e-5af6-4e7f-9abe-c91085e8fdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:23.889593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbf94e-5af6-4e7f-9abe-c91085e8fdfd None admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:23.889874 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbf94e-5af6-4e7f-9abe-c91085e8fdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:23.890149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbf94e-5af6-4e7f-9abe-c91085e8fdfd None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:23.890907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbf94e-5af6-4e7f-9abe-c91085e8fdfd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:23.892272 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbf94e-5af6-4e7f-9abe-c91085e8fdfd None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:23.958896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 656/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Apr 28 16:23:23 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:23:26.191844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5058d-21d3-4595-acf7-b62a85061b75 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:26.192389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5058d-21d3-4595-acf7-b62a85061b75 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:26.192389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5058d-21d3-4595-acf7-b62a85061b75 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:26.193753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 640/1296] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:23:26.199632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46715-2a8b-4b55-9a0e-e82ba738a86d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:26.200031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46715-2a8b-4b55-9a0e-e82ba738a86d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:26.200194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c46715-2a8b-4b55-9a0e-e82ba738a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:26.216960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-15c46715-2a8b-4b55-9a0e-e82ba738a86d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:23:26.218154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-15c46715-2a8b-4b55-9a0e-e82ba738a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:23:26.286760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 657/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:23:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:23:26.309498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5058d-21d3-4595-acf7-b62a85061b75 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:26.409511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5058d-21d3-4595-acf7-b62a85061b75 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:26.441872 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:26.442693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:26.442976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:26.443317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:26.443977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:26.445330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:26.456112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 28 16:23:26.457302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 641/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:23:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:26.463821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c46715-2a8b-4b55-9a0e-e82ba738a86d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:26.557862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c46715-2a8b-4b55-9a0e-e82ba738a86d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:26.589835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:26.590484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:26.590791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:26.591065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:26.591768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:26.592075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:26.593435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:26.598579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 658/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Apr 28 16:23:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:26.605256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:26.698459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aaf2c9-66a4-4488-848e-52c22e60b343 None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:26.730425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6bbd-3ffd-46ac-b64d-220759815617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:26.731099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6bbd-3ffd-46ac-b64d-220759815617 None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:26.731383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6bbd-3ffd-46ac-b64d-220759815617 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:26.731662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6bbd-3ffd-46ac-b64d-220759815617 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:26.732447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d6bbd-3ffd-46ac-b64d-220759815617 None admin] RBAC: Adding query filter params (interface=public, service_id=b19cb4afbea64a6cadf96e8eab3b08f9, region_id=RegionOne) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:26.732759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d6bbd-3ffd-46ac-b64d-220759815617 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:26.734125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d6bbd-3ffd-46ac-b64d-220759815617 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:26.738977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 642/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Apr 28 16:23:26 2022] GET /identity/v3/endpoints?service_id=b19cb4afbea64a6cadf96e8eab3b08f9&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:26.744722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:26.840018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792c4f8-e2be-423b-a7d6-b35781931c8e None admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:26.872816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76bfb0-13a8-48e8-9a92-3b481d69b7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:26.873488 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76bfb0-13a8-48e8-9a92-3b481d69b7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:26.873761 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76bfb0-13a8-48e8-9a92-3b481d69b7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:26.874043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76bfb0-13a8-48e8-9a92-3b481d69b7d7 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:26.874759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76bfb0-13a8-48e8-9a92-3b481d69b7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:26.876138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76bfb0-13a8-48e8-9a92-3b481d69b7d7 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:26.882876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 659/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Apr 28 16:23:26 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:23:29.110962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebe186-b9ae-4b94-9b02-555c9e4cfcd5 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:29.111522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebe186-b9ae-4b94-9b02-555c9e4cfcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:29.111522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebe186-b9ae-4b94-9b02-555c9e4cfcd5 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:29.112901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 643/1302] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:23:29.118582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59bb0-50f0-4226-8bd6-9f2a6811bfc6 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:29.120108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59bb0-50f0-4226-8bd6-9f2a6811bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:29.120108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59bb0-50f0-4226-8bd6-9f2a6811bfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:29.135990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-64a59bb0-50f0-4226-8bd6-9f2a6811bfc6 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:23:29.137177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-64a59bb0-50f0-4226-8bd6-9f2a6811bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:23:29.200810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 660/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:23:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 28 16:23:29.223735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebe186-b9ae-4b94-9b02-555c9e4cfcd5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:29.320930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebe186-b9ae-4b94-9b02-555c9e4cfcd5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:29.353024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:29.353839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:29.354099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:29.354372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:29.355068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:29.356469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:29.367348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING keystone.server.flask.application [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 28 16:23:29.373566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 644/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Apr 28 16:23:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 28 16:23:29.374480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a59bb0-50f0-4226-8bd6-9f2a6811bfc6 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:29.473658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a59bb0-50f0-4226-8bd6-9f2a6811bfc6 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:29.505565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59f90c-54f9-46f2-a997-c21898169c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:29.506223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f90c-54f9-46f2-a997-c21898169c57 None admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:29.506509 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f90c-54f9-46f2-a997-c21898169c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:29.506821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59f90c-54f9-46f2-a997-c21898169c57 None admin] PATH_INFO: `/v3/services` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:29.507578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59f90c-54f9-46f2-a997-c21898169c57 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:23:29.507887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59f90c-54f9-46f2-a997-c21898169c57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:29.509912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59f90c-54f9-46f2-a997-c21898169c57 None admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:29.514937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 661/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Apr 28 16:23:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:23:29.520809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:23:29.615599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e11ff-e076-4fec-be45-30d1f18ac3fb None admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:23:29.647529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe6211-7061-4f58-833c-65a49a28b2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:23:29.648178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6211-7061-4f58-833c-65a49a28b2e1 None admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:23:29.648483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6211-7061-4f58-833c-65a49a28b2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:23:29.648756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe6211-7061-4f58-833c-65a49a28b2e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:23:29.649956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe6211-7061-4f58-833c-65a49a28b2e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:23:29.651270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe6211-7061-4f58-833c-65a49a28b2e1 None admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:23:29.766852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 645/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Apr 28 16:23:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:29:36.249763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e711a-f875-4d4a-abdf-5685be809014 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:36.250712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e711a-f875-4d4a-abdf-5685be809014 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:36.251136 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e711a-f875-4d4a-abdf-5685be809014 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:36.258299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb022-c629-4311-a745-7d397f468863 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:36.259138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb022-c629-4311-a745-7d397f468863 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:36.259562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccb022-c629-4311-a745-7d397f468863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:36.262813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 662/1307] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:29:36 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:36.362705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-beccb022-c629-4311-a745-7d397f468863 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:36.367731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-beccb022-c629-4311-a745-7d397f468863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:36.552738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 646/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:29:36.590449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd983-a32b-488c-9ecd-c50a84238109 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:36.591206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd983-a32b-488c-9ecd-c50a84238109 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:36.591882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd983-a32b-488c-9ecd-c50a84238109 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:36.595203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 663/1309] 10.222.0.43 () {54 vars in 964 bytes} [Thu Apr 28 16:29:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:36.601316 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d81b9-550b-4b80-9484-b0bd97bb60c2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:36.601612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d81b9-550b-4b80-9484-b0bd97bb60c2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:36.601895 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d81b9-550b-4b80-9484-b0bd97bb60c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:36.686566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7e8d81b9-550b-4b80-9484-b0bd97bb60c2 None None] MFA Rules not processed for user `ebf1f55dbef94868aaac6d39ed70690b`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:36.687946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7e8d81b9-550b-4b80-9484-b0bd97bb60c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:36.764924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 647/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Apr 28 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:29:36.774305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd983-a32b-488c-9ecd-c50a84238109 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:29:36.776155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0b8dd983-a32b-488c-9ecd-c50a84238109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:36.896668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd983-a32b-488c-9ecd-c50a84238109 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:29:36.959238 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711f288-2c95-420f-af49-a1e275bcc259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:29:36.960180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f288-2c95-420f-af49-a1e275bcc259 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:36.960464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f288-2c95-420f-af49-a1e275bcc259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:36.960740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711f288-2c95-420f-af49-a1e275bcc259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:36.962423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a711f288-2c95-420f-af49-a1e275bcc259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:37.085469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711f288-2c95-420f-af49-a1e275bcc259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:29:37.086972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711f288-2c95-420f-af49-a1e275bcc259 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:29:37.108040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 664/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:29:39.673739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd994-9375-4218-8be4-e28bf2bff54c None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:39.673739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd994-9375-4218-8be4-e28bf2bff54c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:39.673739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd994-9375-4218-8be4-e28bf2bff54c None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:39.675021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 648/1312] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:39.681054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab140-eda9-4c1b-9940-c72552e7c266 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:39.681525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab140-eda9-4c1b-9940-c72552e7c266 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:39.681649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab140-eda9-4c1b-9940-c72552e7c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:39.762901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-778ab140-eda9-4c1b-9940-c72552e7c266 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:39.764275 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-778ab140-eda9-4c1b-9940-c72552e7c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:39.868058 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 665/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:29:39.905554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cd994-9375-4218-8be4-e28bf2bff54c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:29:39.907285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-110cd994-9375-4218-8be4-e28bf2bff54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:40.020656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cd994-9375-4218-8be4-e28bf2bff54c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:29:40.101457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92e065-afe0-475a-8982-1e102c4ab65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:29:40.102126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e065-afe0-475a-8982-1e102c4ab65d service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:40.102451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e065-afe0-475a-8982-1e102c4ab65d service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:40.102749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92e065-afe0-475a-8982-1e102c4ab65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:40.104691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-cb92e065-afe0-475a-8982-1e102c4ab65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:40.222158 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92e065-afe0-475a-8982-1e102c4ab65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:29:40.223849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92e065-afe0-475a-8982-1e102c4ab65d service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:29:40.244040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 649/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:29:43.032460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6aba7-2b90-4603-9678-b5a509a1c564 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:43.033003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6aba7-2b90-4603-9678-b5a509a1c564 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:43.033003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6aba7-2b90-4603-9678-b5a509a1c564 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:43.034453 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 666/1315] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:43.039869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d978179-768b-4e6e-a392-407e84d6001c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:43.046693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d978179-768b-4e6e-a392-407e84d6001c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:43.046693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d978179-768b-4e6e-a392-407e84d6001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:43.103075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5d978179-768b-4e6e-a392-407e84d6001c None None] MFA Rules not processed for user `2afbe91729da44b8b75f76700e73be12`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:43.104291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5d978179-768b-4e6e-a392-407e84d6001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:43.198786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 650/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:29:43.254976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33869be3-03ca-4044-a4a6-3fbc187ec253 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:43.255261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33869be3-03ca-4044-a4a6-3fbc187ec253 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:43.255546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33869be3-03ca-4044-a4a6-3fbc187ec253 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:43.256990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 667/1317] 10.222.0.43 () {54 vars in 964 bytes} [Thu Apr 28 16:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:43.262714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dca08-5335-4bcc-83eb-fa0e0a0fb1ae None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:43.263009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dca08-5335-4bcc-83eb-fa0e0a0fb1ae None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:43.263288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dca08-5335-4bcc-83eb-fa0e0a0fb1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:43.335199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-c40dca08-5335-4bcc-83eb-fa0e0a0fb1ae None None] MFA Rules not processed for user `ebf1f55dbef94868aaac6d39ed70690b`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:43.336404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c40dca08-5335-4bcc-83eb-fa0e0a0fb1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:43.411998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 651/1318] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Apr 28 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:29:43.423792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33869be3-03ca-4044-a4a6-3fbc187ec253 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:29:43.425336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-33869be3-03ca-4044-a4a6-3fbc187ec253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:43.525783 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33869be3-03ca-4044-a4a6-3fbc187ec253 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:29:43.596259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b379f3-d885-435f-a2aa-f34037bd18a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:29:43.596838 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b379f3-d885-435f-a2aa-f34037bd18a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:43.597122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b379f3-d885-435f-a2aa-f34037bd18a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:43.597400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b379f3-d885-435f-a2aa-f34037bd18a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:43.599689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-21b379f3-d885-435f-a2aa-f34037bd18a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:43.704639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b379f3-d885-435f-a2aa-f34037bd18a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:29:43.706134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b379f3-d885-435f-a2aa-f34037bd18a2 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:29:43.726911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 668/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:29:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:29:47.189600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c437-cfe1-41e2-9db9-2d1008f72961 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:47.190117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c437-cfe1-41e2-9db9-2d1008f72961 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:47.190210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0c437-cfe1-41e2-9db9-2d1008f72961 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:47.191708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 652/1320] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:47.196923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808108-9a9c-4d71-af35-13f89198d1c1 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:47.197308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808108-9a9c-4d71-af35-13f89198d1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:47.197532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808108-9a9c-4d71-af35-13f89198d1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:47.261750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-3f808108-9a9c-4d71-af35-13f89198d1c1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:47.262984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3f808108-9a9c-4d71-af35-13f89198d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:47.357229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 669/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:29:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:29:47.396421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c437-cfe1-41e2-9db9-2d1008f72961 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:29:47.398008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-83b0c437-cfe1-41e2-9db9-2d1008f72961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:47.523382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0c437-cfe1-41e2-9db9-2d1008f72961 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:29:47.592130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8332d-7ae2-4272-890e-62dc28119a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:29:47.592776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8332d-7ae2-4272-890e-62dc28119a3a service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:47.593062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8332d-7ae2-4272-890e-62dc28119a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:47.593337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8332d-7ae2-4272-890e-62dc28119a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:47.595013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e3b8332d-7ae2-4272-890e-62dc28119a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:47.697205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8332d-7ae2-4272-890e-62dc28119a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:29:47.698579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8332d-7ae2-4272-890e-62dc28119a3a service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:29:47.716177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 653/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:29:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:29:51.023091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593956c-e4eb-4ad5-9042-0db2eb736def None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:51.023645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593956c-e4eb-4ad5-9042-0db2eb736def None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:51.023645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593956c-e4eb-4ad5-9042-0db2eb736def None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:51.025047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 670/1323] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:51.030253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47d26-a4fc-460d-aa79-9a90a8391d2c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:51.030654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47d26-a4fc-460d-aa79-9a90a8391d2c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:51.030848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47d26-a4fc-460d-aa79-9a90a8391d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:51.095324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-2ad47d26-a4fc-460d-aa79-9a90a8391d2c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:51.096535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2ad47d26-a4fc-460d-aa79-9a90a8391d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:51.189256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 654/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:29:51.225383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593956c-e4eb-4ad5-9042-0db2eb736def None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:29:51.226944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8593956c-e4eb-4ad5-9042-0db2eb736def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:51.326315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593956c-e4eb-4ad5-9042-0db2eb736def None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:29:51.396904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c068dc-53ac-4324-bfda-0dbe79ec4560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:29:51.397557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c068dc-53ac-4324-bfda-0dbe79ec4560 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:51.397848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c068dc-53ac-4324-bfda-0dbe79ec4560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:51.398126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c068dc-53ac-4324-bfda-0dbe79ec4560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:51.399803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b3c068dc-53ac-4324-bfda-0dbe79ec4560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:51.504812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c068dc-53ac-4324-bfda-0dbe79ec4560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:29:51.506271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c068dc-53ac-4324-bfda-0dbe79ec4560 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:29:51.524243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 671/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:29:53.853924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1731b-d2f1-42d8-8e4f-05932baa51b3 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:53.854527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1731b-d2f1-42d8-8e4f-05932baa51b3 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:53.854527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1731b-d2f1-42d8-8e4f-05932baa51b3 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:53.855898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 655/1326] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:53.861038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c339d3-2f9b-4c63-861d-eb781ab86776 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:53.861478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c339d3-2f9b-4c63-861d-eb781ab86776 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:53.861590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c339d3-2f9b-4c63-861d-eb781ab86776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:53.924634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-86c339d3-2f9b-4c63-861d-eb781ab86776 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:53.925867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-86c339d3-2f9b-4c63-861d-eb781ab86776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:54.021511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 672/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:29:54.058051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1731b-d2f1-42d8-8e4f-05932baa51b3 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:29:54.059627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-63f1731b-d2f1-42d8-8e4f-05932baa51b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:54.170098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1731b-d2f1-42d8-8e4f-05932baa51b3 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:29:54.242144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a21a3-3e9d-4393-9e78-5a0c0c3bd2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:29:54.242804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a21a3-3e9d-4393-9e78-5a0c0c3bd2cb service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:54.243095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a21a3-3e9d-4393-9e78-5a0c0c3bd2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:54.243377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a21a3-3e9d-4393-9e78-5a0c0c3bd2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:54.245018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-839a21a3-3e9d-4393-9e78-5a0c0c3bd2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:54.350113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a21a3-3e9d-4393-9e78-5a0c0c3bd2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:29:54.351599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a21a3-3e9d-4393-9e78-5a0c0c3bd2cb service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:29:54.369355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 656/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:29:56.672704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641e777-28fd-44e4-a687-f02bb8e8c3ae None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:56.673280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641e777-28fd-44e4-a687-f02bb8e8c3ae None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:56.673280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641e777-28fd-44e4-a687-f02bb8e8c3ae None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:56.674945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 673/1329] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:56.679884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dfdbe-2ba5-4d24-8222-726881da0797 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:56.680291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dfdbe-2ba5-4d24-8222-726881da0797 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:56.680447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dfdbe-2ba5-4d24-8222-726881da0797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:56.744041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-114dfdbe-2ba5-4d24-8222-726881da0797 None None] MFA Rules not processed for user `2afbe91729da44b8b75f76700e73be12`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:56.745258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-114dfdbe-2ba5-4d24-8222-726881da0797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:56.839162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 657/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:29:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:29:56.875975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641e777-28fd-44e4-a687-f02bb8e8c3ae None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:29:56.877594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b641e777-28fd-44e4-a687-f02bb8e8c3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:56.980404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641e777-28fd-44e4-a687-f02bb8e8c3ae None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:29:57.052891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7ab8b-d3d4-4030-b3dd-7e7627926701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:29:57.053558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ab8b-d3d4-4030-b3dd-7e7627926701 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:57.053845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ab8b-d3d4-4030-b3dd-7e7627926701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:57.054124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7ab8b-d3d4-4030-b3dd-7e7627926701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:57.055808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-92c7ab8b-d3d4-4030-b3dd-7e7627926701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:29:57.161021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7ab8b-d3d4-4030-b3dd-7e7627926701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:29:57.162472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7ab8b-d3d4-4030-b3dd-7e7627926701 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:29:57.180881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 674/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:29:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:29:59.858584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36303a1-72da-436c-8d72-1e464fbc595c None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:59.859130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36303a1-72da-436c-8d72-1e464fbc595c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:59.859130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36303a1-72da-436c-8d72-1e464fbc595c None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:59.860534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 658/1332] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:29:59.866262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768dfdd-76fa-4581-84a6-56c6aa6270ec None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:29:59.866699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768dfdd-76fa-4581-84a6-56c6aa6270ec None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:29:59.866956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768dfdd-76fa-4581-84a6-56c6aa6270ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:29:59.930528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4768dfdd-76fa-4581-84a6-56c6aa6270ec None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:29:59.931711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4768dfdd-76fa-4581-84a6-56c6aa6270ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:00.030413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 675/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:00.067290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36303a1-72da-436c-8d72-1e464fbc595c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:00.068870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e36303a1-72da-436c-8d72-1e464fbc595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:00.171327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36303a1-72da-436c-8d72-1e464fbc595c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:00.245684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915f5e5-d642-4423-9ff5-4d78a3ff7cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:00.246182 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f5e5-d642-4423-9ff5-4d78a3ff7cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:00.246472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f5e5-d642-4423-9ff5-4d78a3ff7cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:00.246782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f5e5-d642-4423-9ff5-4d78a3ff7cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:00.248467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d915f5e5-d642-4423-9ff5-4d78a3ff7cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:00.366059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915f5e5-d642-4423-9ff5-4d78a3ff7cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:00.368884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915f5e5-d642-4423-9ff5-4d78a3ff7cc3 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:00.389199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 659/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:02.711928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b5bc-3315-4e42-8d27-a93455806a3f None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:02.712459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b5bc-3315-4e42-8d27-a93455806a3f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:02.712459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b5bc-3315-4e42-8d27-a93455806a3f None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:02.713844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 676/1335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:02.719167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ec0e8-876b-4db7-b14a-0de62a2887b5 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:02.719540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ec0e8-876b-4db7-b14a-0de62a2887b5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:02.719739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ec0e8-876b-4db7-b14a-0de62a2887b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:02.782881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-cc8ec0e8-876b-4db7-b14a-0de62a2887b5 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:02.784094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-cc8ec0e8-876b-4db7-b14a-0de62a2887b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:02.876440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 660/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:02.916549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b5bc-3315-4e42-8d27-a93455806a3f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:02.918411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2523b5bc-3315-4e42-8d27-a93455806a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:03.027446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b5bc-3315-4e42-8d27-a93455806a3f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:03.105566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76421d-2bde-4f2d-8984-ee739ba25429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:03.106222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76421d-2bde-4f2d-8984-ee739ba25429 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:03.106508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76421d-2bde-4f2d-8984-ee739ba25429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:03.106825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76421d-2bde-4f2d-8984-ee739ba25429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:03.108477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-7d76421d-2bde-4f2d-8984-ee739ba25429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:03.212179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76421d-2bde-4f2d-8984-ee739ba25429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:03.213620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76421d-2bde-4f2d-8984-ee739ba25429 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:03.230774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 677/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:06.232284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d572cc-385a-4a17-9bbc-0c78e637f43e None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:06.232824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d572cc-385a-4a17-9bbc-0c78e637f43e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:06.232824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d572cc-385a-4a17-9bbc-0c78e637f43e None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:06.234234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 661/1338] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:30:06.239603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7730ac-6e25-4bf1-942e-ffd89f1fcd21 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:06.239985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7730ac-6e25-4bf1-942e-ffd89f1fcd21 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:06.240169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7730ac-6e25-4bf1-942e-ffd89f1fcd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:06.304630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-6a7730ac-6e25-4bf1-942e-ffd89f1fcd21 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:06.305790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6a7730ac-6e25-4bf1-942e-ffd89f1fcd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:06.400551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 678/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:06.436229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d572cc-385a-4a17-9bbc-0c78e637f43e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:06.439289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a7d572cc-385a-4a17-9bbc-0c78e637f43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:06.552031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d572cc-385a-4a17-9bbc-0c78e637f43e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:06.555884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bdd32-ff24-43dd-a5da-1306f904a5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:06.556482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bdd32-ff24-43dd-a5da-1306f904a5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:06.556765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bdd32-ff24-43dd-a5da-1306f904a5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:06.557043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bdd32-ff24-43dd-a5da-1306f904a5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:06.558846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3b6bdd32-ff24-43dd-a5da-1306f904a5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:06.663195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bdd32-ff24-43dd-a5da-1306f904a5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:06.664633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bdd32-ff24-43dd-a5da-1306f904a5f9 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:06.684497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 662/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:11.356552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7b3f-fc12-4abb-90c7-fcbe0162cd20 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:11.357103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7b3f-fc12-4abb-90c7-fcbe0162cd20 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:11.357103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7b3f-fc12-4abb-90c7-fcbe0162cd20 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:11.358464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 679/1341] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:11.364180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59419d6-3aee-4d74-96c8-ed884b75031c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:11.364649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59419d6-3aee-4d74-96c8-ed884b75031c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:11.364920 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59419d6-3aee-4d74-96c8-ed884b75031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:11.410980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e59419d6-3aee-4d74-96c8-ed884b75031c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:11.412125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e59419d6-3aee-4d74-96c8-ed884b75031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:11.489996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 663/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:11.527826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7b3f-fc12-4abb-90c7-fcbe0162cd20 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:11.540231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7b3f-fc12-4abb-90c7-fcbe0162cd20 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:11.543992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff50c74-46f2-4079-94a8-6651350ae8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:11.544629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50c74-46f2-4079-94a8-6651350ae8cb service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:11.544934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50c74-46f2-4079-94a8-6651350ae8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:11.545196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50c74-46f2-4079-94a8-6651350ae8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:11.554649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff50c74-46f2-4079-94a8-6651350ae8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:11.556087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff50c74-46f2-4079-94a8-6651350ae8cb service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:11.565462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 680/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:14.823868 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb6df0-d15f-46d1-ad62-ad8e118937d6 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:14.824395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb6df0-d15f-46d1-ad62-ad8e118937d6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:14.824519 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb6df0-d15f-46d1-ad62-ad8e118937d6 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:14.825970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 664/1344] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:14.831154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6295-8e3e-4046-95df-0d5f0f7484fa None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:14.831579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6295-8e3e-4046-95df-0d5f0f7484fa None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:14.831766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6295-8e3e-4046-95df-0d5f0f7484fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:14.858332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-032b6295-8e3e-4046-95df-0d5f0f7484fa None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:14.859638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-032b6295-8e3e-4046-95df-0d5f0f7484fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:14.868114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 681/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:14.907045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb6df0-d15f-46d1-ad62-ad8e118937d6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:14.908790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-26eb6df0-d15f-46d1-ad62-ad8e118937d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:14.921817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb6df0-d15f-46d1-ad62-ad8e118937d6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:14.930232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a554-63f9-49fa-b4da-2993ea0c0236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:14.930953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a554-63f9-49fa-b4da-2993ea0c0236 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:14.931239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a554-63f9-49fa-b4da-2993ea0c0236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:14.931524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a554-63f9-49fa-b4da-2993ea0c0236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:14.942837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7a554-63f9-49fa-b4da-2993ea0c0236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:14.944279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7a554-63f9-49fa-b4da-2993ea0c0236 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:14.953722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 665/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:30:19.766467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08e20-8d56-4082-a638-0a9d13d5f1cc None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:19.767022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08e20-8d56-4082-a638-0a9d13d5f1cc None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:19.767022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08e20-8d56-4082-a638-0a9d13d5f1cc None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:19.768317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 682/1347] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:19.774147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8ae1-247a-4fcf-8121-4118949631f2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:19.774620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8ae1-247a-4fcf-8121-4118949631f2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:19.774745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8ae1-247a-4fcf-8121-4118949631f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:19.793082 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-776f8ae1-247a-4fcf-8121-4118949631f2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:19.794266 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-776f8ae1-247a-4fcf-8121-4118949631f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:19.803204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 666/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:19.839771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf08e20-8d56-4082-a638-0a9d13d5f1cc None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:19.850930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf08e20-8d56-4082-a638-0a9d13d5f1cc None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:19.854424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb48f19-c789-42e4-a3c2-60ca470fd6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:19.855103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb48f19-c789-42e4-a3c2-60ca470fd6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:19.855391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb48f19-c789-42e4-a3c2-60ca470fd6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:19.855673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb48f19-c789-42e4-a3c2-60ca470fd6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:19.865930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb48f19-c789-42e4-a3c2-60ca470fd6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:19.867454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb48f19-c789-42e4-a3c2-60ca470fd6a6 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:19.877438 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 683/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:25.462219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f23a1-ca1a-4d6f-8b16-76473f15c149 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:25.463058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f23a1-ca1a-4d6f-8b16-76473f15c149 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:25.463219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f23a1-ca1a-4d6f-8b16-76473f15c149 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:25.465150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 667/1350] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:30:25.471014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926d7c2-7028-4e01-b48e-3a824ef42fda None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:25.471541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926d7c2-7028-4e01-b48e-3a824ef42fda None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:25.471623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926d7c2-7028-4e01-b48e-3a824ef42fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:25.554130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-5926d7c2-7028-4e01-b48e-3a824ef42fda None None] MFA Rules not processed for user `ded012db549b45669a4ffcdd988b55ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:25.555825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5926d7c2-7028-4e01-b48e-3a824ef42fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:25.663336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 684/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:30.425961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2cef-9e60-4690-969e-36fc8043d827 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:30.426499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2cef-9e60-4690-969e-36fc8043d827 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:30.426499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed2cef-9e60-4690-969e-36fc8043d827 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:30.428646 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 668/1352] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:30:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:30.433451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a733cf-f2b4-42ae-9d9f-4aff6482bff5 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:30.433909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a733cf-f2b4-42ae-9d9f-4aff6482bff5 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:30.442311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a733cf-f2b4-42ae-9d9f-4aff6482bff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:30.456900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c1a733cf-f2b4-42ae-9d9f-4aff6482bff5 None None] MFA Rules not processed for user `ded012db549b45669a4ffcdd988b55ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:30.459494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c1a733cf-f2b4-42ae-9d9f-4aff6482bff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:30.480164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 685/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:30:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:32.181194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33db11-8358-49cf-9fa5-13a00cb91b8d None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:32.182038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33db11-8358-49cf-9fa5-13a00cb91b8d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:32.182315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33db11-8358-49cf-9fa5-13a00cb91b8d None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:32.183916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 669/1354] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:32.189614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e601fb-18b0-44a5-bacd-52b0256a408b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:32.190776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e601fb-18b0-44a5-bacd-52b0256a408b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:32.190776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e601fb-18b0-44a5-bacd-52b0256a408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:32.210457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-83e601fb-18b0-44a5-bacd-52b0256a408b None None] MFA Rules not processed for user `ded012db549b45669a4ffcdd988b55ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:32.212326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-83e601fb-18b0-44a5-bacd-52b0256a408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:32.221424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 686/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:30:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:35.921000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364bf3b-9835-4633-bfa1-f0d0e3f8c6ea None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:35.921545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364bf3b-9835-4633-bfa1-f0d0e3f8c6ea None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:35.921545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364bf3b-9835-4633-bfa1-f0d0e3f8c6ea None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:35.926704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 670/1356] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:35.935069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319917a-053a-48df-b74d-f0ca54e2f053 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:35.935970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319917a-053a-48df-b74d-f0ca54e2f053 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:35.936751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319917a-053a-48df-b74d-f0ca54e2f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:35.955893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b319917a-053a-48df-b74d-f0ca54e2f053 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:35.957357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b319917a-053a-48df-b74d-f0ca54e2f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:35.967339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 687/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:30:36.025565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1839de-00b1-4b7d-b4db-91802cd92658 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:36.026090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1839de-00b1-4b7d-b4db-91802cd92658 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:36.026521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1839de-00b1-4b7d-b4db-91802cd92658 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:36.028497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 671/1358] 10.222.0.43 () {54 vars in 960 bytes} [Thu Apr 28 16:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:36.046799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8f0b-18a5-4dc5-a909-1a7dbfa0df27 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:36.047452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8f0b-18a5-4dc5-a909-1a7dbfa0df27 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:36.047964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8f0b-18a5-4dc5-a909-1a7dbfa0df27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:36.112886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-301b8f0b-18a5-4dc5-a909-1a7dbfa0df27 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:36.114858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-301b8f0b-18a5-4dc5-a909-1a7dbfa0df27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:36.230311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 688/1359] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Apr 28 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:36.236017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1839de-00b1-4b7d-b4db-91802cd92658 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:36.262014 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1839de-00b1-4b7d-b4db-91802cd92658 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:36.269547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa668ed8-0dee-420a-9cd9-4a3f4470120d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:36.272306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668ed8-0dee-420a-9cd9-4a3f4470120d service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:36.272926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668ed8-0dee-420a-9cd9-4a3f4470120d service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:36.273442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa668ed8-0dee-420a-9cd9-4a3f4470120d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:36.283422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa668ed8-0dee-420a-9cd9-4a3f4470120d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:36.285367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa668ed8-0dee-420a-9cd9-4a3f4470120d service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:36.305355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 672/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:38.824761 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b829-f28f-49c6-86c3-bac001e26155 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:38.825397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b829-f28f-49c6-86c3-bac001e26155 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:38.825397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271b829-f28f-49c6-86c3-bac001e26155 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:38.826909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 689/1361] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:38.832633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f17618-471d-4d51-a495-6aa69d27400a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:38.833179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f17618-471d-4d51-a495-6aa69d27400a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:38.833268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f17618-471d-4d51-a495-6aa69d27400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:38.852774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b2f17618-471d-4d51-a495-6aa69d27400a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:38.854080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b2f17618-471d-4d51-a495-6aa69d27400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:38.862516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 673/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:38.909166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271b829-f28f-49c6-86c3-bac001e26155 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:38.926343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271b829-f28f-49c6-86c3-bac001e26155 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:38.932457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75a477-b8f8-473c-9ad3-c802598bf472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:38.933317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a477-b8f8-473c-9ad3-c802598bf472 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:38.933610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a477-b8f8-473c-9ad3-c802598bf472 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:38.933890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a477-b8f8-473c-9ad3-c802598bf472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:38.944510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75a477-b8f8-473c-9ad3-c802598bf472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:38.946378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75a477-b8f8-473c-9ad3-c802598bf472 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:38.958383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 690/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:41.660856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307e5af-8163-4e93-aa39-b0219d1618ec None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:41.661374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307e5af-8163-4e93-aa39-b0219d1618ec None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:41.661498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307e5af-8163-4e93-aa39-b0219d1618ec None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:41.662838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 674/1364] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:41.668415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13928-3bc7-4a3d-8edd-68c5b0e032a7 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:41.668814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13928-3bc7-4a3d-8edd-68c5b0e032a7 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:41.669006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c13928-3bc7-4a3d-8edd-68c5b0e032a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:41.687737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c6c13928-3bc7-4a3d-8edd-68c5b0e032a7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:41.688958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c6c13928-3bc7-4a3d-8edd-68c5b0e032a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:41.697632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 691/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:30:41.743348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaea67-84a5-49ea-bb37-20d5fe27ae8d None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:41.743642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaea67-84a5-49ea-bb37-20d5fe27ae8d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:41.743923 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaea67-84a5-49ea-bb37-20d5fe27ae8d None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:41.745279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 675/1366] 10.222.0.43 () {54 vars in 960 bytes} [Thu Apr 28 16:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:41.750695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289e292-176d-4366-9f42-f3fa1c49335e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:41.750990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289e292-176d-4366-9f42-f3fa1c49335e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:41.751274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289e292-176d-4366-9f42-f3fa1c49335e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:41.769935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1289e292-176d-4366-9f42-f3fa1c49335e None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:41.771163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1289e292-176d-4366-9f42-f3fa1c49335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:41.780407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 692/1367] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Apr 28 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:41.788073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaea67-84a5-49ea-bb37-20d5fe27ae8d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:41.803209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaea67-84a5-49ea-bb37-20d5fe27ae8d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:41.808617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6f24-67d6-482e-8e29-d90ee41355fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:41.809284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6f24-67d6-482e-8e29-d90ee41355fa service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:41.809567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6f24-67d6-482e-8e29-d90ee41355fa service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:41.810028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6f24-67d6-482e-8e29-d90ee41355fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:41.818730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6f24-67d6-482e-8e29-d90ee41355fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:41.820522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6f24-67d6-482e-8e29-d90ee41355fa service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:41.829711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 676/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:44.363995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466850-8686-4258-95a2-493f8f7715a5 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:44.364844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466850-8686-4258-95a2-493f8f7715a5 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:44.365615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466850-8686-4258-95a2-493f8f7715a5 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:44.369735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 693/1369] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:44.375692 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d256183-8d6f-4406-bd32-45f491cb9efc None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:44.376153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d256183-8d6f-4406-bd32-45f491cb9efc None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:44.376430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d256183-8d6f-4406-bd32-45f491cb9efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:44.401275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5d256183-8d6f-4406-bd32-45f491cb9efc None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:44.402835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5d256183-8d6f-4406-bd32-45f491cb9efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:44.414682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 677/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:44.457266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466850-8686-4258-95a2-493f8f7715a5 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:44.474347 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466850-8686-4258-95a2-493f8f7715a5 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:44.480710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1146e-098e-46f1-aa48-dddf04349940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:44.481536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1146e-098e-46f1-aa48-dddf04349940 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:44.481950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1146e-098e-46f1-aa48-dddf04349940 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:44.482375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1146e-098e-46f1-aa48-dddf04349940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:44.492404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1146e-098e-46f1-aa48-dddf04349940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:44.494406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1146e-098e-46f1-aa48-dddf04349940 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:44.506434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 694/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:44.785069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e127-786e-437f-ae67-1e2b5837f293 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:44.785365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e127-786e-437f-ae67-1e2b5837f293 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:44.785926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e127-786e-437f-ae67-1e2b5837f293 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:44.787531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 678/1372] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:30:44.793980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d5a3-95df-428f-bb8b-923bd3270f01 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:44.794274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d5a3-95df-428f-bb8b-923bd3270f01 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:44.794827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d5a3-95df-428f-bb8b-923bd3270f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:44.815573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b736d5a3-95df-428f-bb8b-923bd3270f01 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:44.816916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b736d5a3-95df-428f-bb8b-923bd3270f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:44.825464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 695/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:30:45.139217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e148b-5634-4bd3-b6da-e5ecd362915e None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:45.139217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e148b-5634-4bd3-b6da-e5ecd362915e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:45.139217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e148b-5634-4bd3-b6da-e5ecd362915e None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:45.144755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 679/1374] 10.222.0.43 () {54 vars in 962 bytes} [Thu Apr 28 16:30:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:45.150372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f6193-b308-4759-a012-91e103c1f6ea None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:45.150796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f6193-b308-4759-a012-91e103c1f6ea None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:45.151154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f6193-b308-4759-a012-91e103c1f6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:45.201951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-408f6193-b308-4759-a012-91e103c1f6ea None None] MFA Rules not processed for user `9a5c2cf875f8451890e04b97b9686956`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:45.203315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-408f6193-b308-4759-a012-91e103c1f6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:45.265213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 696/1375] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Apr 28 16:30:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:30:45.273679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e148b-5634-4bd3-b6da-e5ecd362915e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:45.284810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e148b-5634-4bd3-b6da-e5ecd362915e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:45.292618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e384e90-f901-4851-8ee6-f1325ce3c460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:45.292618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384e90-f901-4851-8ee6-f1325ce3c460 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:45.292618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384e90-f901-4851-8ee6-f1325ce3c460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:45.292618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e384e90-f901-4851-8ee6-f1325ce3c460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:45.299778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e384e90-f901-4851-8ee6-f1325ce3c460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:45.301757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e384e90-f901-4851-8ee6-f1325ce3c460 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:45.311971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 680/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:30:46.961171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1770-1008-4a22-b0d5-0178f6697ddc None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:46.961737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1770-1008-4a22-b0d5-0178f6697ddc None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:46.961737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d1770-1008-4a22-b0d5-0178f6697ddc None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:46.963156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 697/1377] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:46.968468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b1a0-d0ea-4aad-b0f0-5df20a4801e7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:46.968878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b1a0-d0ea-4aad-b0f0-5df20a4801e7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:46.969042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986b1a0-d0ea-4aad-b0f0-5df20a4801e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:46.987927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7986b1a0-d0ea-4aad-b0f0-5df20a4801e7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:46.989136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7986b1a0-d0ea-4aad-b0f0-5df20a4801e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:46.997092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 681/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:47.047335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d1770-1008-4a22-b0d5-0178f6697ddc None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:47.062260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d1770-1008-4a22-b0d5-0178f6697ddc None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:47.068102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf1471-6cb6-4d60-84df-377d654cfa67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:47.068806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1471-6cb6-4d60-84df-377d654cfa67 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:47.069094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1471-6cb6-4d60-84df-377d654cfa67 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:47.069393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1471-6cb6-4d60-84df-377d654cfa67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:47.079009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf1471-6cb6-4d60-84df-377d654cfa67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:47.081937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf1471-6cb6-4d60-84df-377d654cfa67 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:47.097746 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 698/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:49.591650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f28fac-3c60-4b8f-889c-adc53fd0c2ab None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:49.592212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f28fac-3c60-4b8f-889c-adc53fd0c2ab None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:49.592212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f28fac-3c60-4b8f-889c-adc53fd0c2ab None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:49.593604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 682/1380] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:49.599226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981381-b1d2-43d2-b5b7-fe05e7264629 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:49.600047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981381-b1d2-43d2-b5b7-fe05e7264629 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:49.600325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981381-b1d2-43d2-b5b7-fe05e7264629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:49.618844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ea981381-b1d2-43d2-b5b7-fe05e7264629 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:49.620271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ea981381-b1d2-43d2-b5b7-fe05e7264629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:49.629852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 699/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:49.675317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f28fac-3c60-4b8f-889c-adc53fd0c2ab None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:49.689804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f28fac-3c60-4b8f-889c-adc53fd0c2ab None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:49.695622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fa999-4410-454d-b959-eeb976688715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:49.696341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa999-4410-454d-b959-eeb976688715 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:49.696696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa999-4410-454d-b959-eeb976688715 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:49.697094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa999-4410-454d-b959-eeb976688715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:49.706035 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fa999-4410-454d-b959-eeb976688715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:49.707734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fa999-4410-454d-b959-eeb976688715 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:49.717510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 683/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:30:52.212739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e46d-9d3e-4ff0-9490-e06dbcf06fac None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:52.213310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e46d-9d3e-4ff0-9490-e06dbcf06fac None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:52.213310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e46d-9d3e-4ff0-9490-e06dbcf06fac None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:52.214598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 700/1383] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:52.219917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82c1d7-7b38-46e8-a4ed-be788a3b6eca None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:52.221213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82c1d7-7b38-46e8-a4ed-be788a3b6eca None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:52.221515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82c1d7-7b38-46e8-a4ed-be788a3b6eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:52.239617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3c82c1d7-7b38-46e8-a4ed-be788a3b6eca None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:52.240828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3c82c1d7-7b38-46e8-a4ed-be788a3b6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:52.248932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 684/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:52.291432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6e46d-9d3e-4ff0-9490-e06dbcf06fac None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:52.308408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6e46d-9d3e-4ff0-9490-e06dbcf06fac None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:52.315248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15451df1-b1ba-43c1-8155-a7c4a4956cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:52.316014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15451df1-b1ba-43c1-8155-a7c4a4956cf1 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:52.316431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15451df1-b1ba-43c1-8155-a7c4a4956cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:52.316819 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15451df1-b1ba-43c1-8155-a7c4a4956cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:52.326072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15451df1-b1ba-43c1-8155-a7c4a4956cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:52.327847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15451df1-b1ba-43c1-8155-a7c4a4956cf1 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:52.339173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 701/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:54.613953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630be90b-5d1e-4596-8a26-164f490a790a None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:54.614659 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630be90b-5d1e-4596-8a26-164f490a790a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:54.615183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630be90b-5d1e-4596-8a26-164f490a790a None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:54.617525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 685/1386] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:54.623445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0bdbf-1079-4821-8856-f03d2a17927b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:54.623912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0bdbf-1079-4821-8856-f03d2a17927b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:54.624400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0bdbf-1079-4821-8856-f03d2a17927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:54.651932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b0c0bdbf-1079-4821-8856-f03d2a17927b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:54.653949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b0c0bdbf-1079-4821-8856-f03d2a17927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:54.667710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 702/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:54.714216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630be90b-5d1e-4596-8a26-164f490a790a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:54.734485 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630be90b-5d1e-4596-8a26-164f490a790a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:54.740347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af2c33-2f8c-41ed-ad98-ed43710cf6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:54.740991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2c33-2f8c-41ed-ad98-ed43710cf6bb service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:54.741276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2c33-2f8c-41ed-ad98-ed43710cf6bb service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:54.741548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af2c33-2f8c-41ed-ad98-ed43710cf6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:54.750224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af2c33-2f8c-41ed-ad98-ed43710cf6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:54.751962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af2c33-2f8c-41ed-ad98-ed43710cf6bb service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:54.762076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 686/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:30:57.237326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eea7b-da67-4978-b96f-627312828ad8 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:57.237860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eea7b-da67-4978-b96f-627312828ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:57.237972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eea7b-da67-4978-b96f-627312828ad8 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:57.239370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 703/1389] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:30:57.244558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc76c5-d355-4017-aa89-02a6b585bc36 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:57.245078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc76c5-d355-4017-aa89-02a6b585bc36 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:57.245246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc76c5-d355-4017-aa89-02a6b585bc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:57.264630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9edc76c5-d355-4017-aa89-02a6b585bc36 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:30:57.265830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9edc76c5-d355-4017-aa89-02a6b585bc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:30:57.275797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 687/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:30:57.328354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eea7b-da67-4978-b96f-627312828ad8 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:30:57.343841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eea7b-da67-4978-b96f-627312828ad8 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:30:57.349451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c38b0-b714-4e5d-be60-4c70b709289a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:30:57.350092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c38b0-b714-4e5d-be60-4c70b709289a service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:30:57.350381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c38b0-b714-4e5d-be60-4c70b709289a service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:30:57.350697 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c38b0-b714-4e5d-be60-4c70b709289a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:30:57.358911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c38b0-b714-4e5d-be60-4c70b709289a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:30:57.360528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c38b0-b714-4e5d-be60-4c70b709289a service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:30:57.369975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 704/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:31:00.201979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d603314-5743-412b-adb5-9ad76840a767 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:00.202600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d603314-5743-412b-adb5-9ad76840a767 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:00.202600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d603314-5743-412b-adb5-9ad76840a767 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:00.204082 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 688/1392] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:00.209388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfe476-4136-40cc-a130-2e0d1eb8f5ba None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:00.209837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfe476-4136-40cc-a130-2e0d1eb8f5ba None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:00.210067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfe476-4136-40cc-a130-2e0d1eb8f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:00.228400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d8bfe476-4136-40cc-a130-2e0d1eb8f5ba None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:00.229732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d8bfe476-4136-40cc-a130-2e0d1eb8f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:00.238268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 705/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:00.282481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d603314-5743-412b-adb5-9ad76840a767 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:00.297475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d603314-5743-412b-adb5-9ad76840a767 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:00.303806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a46d1-086e-4ebe-94e5-4d826ebf7677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:00.304395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a46d1-086e-4ebe-94e5-4d826ebf7677 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:00.304677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a46d1-086e-4ebe-94e5-4d826ebf7677 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:00.304949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a46d1-086e-4ebe-94e5-4d826ebf7677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:00.313422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a46d1-086e-4ebe-94e5-4d826ebf7677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:00.315068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a46d1-086e-4ebe-94e5-4d826ebf7677 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:00.324762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 689/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:01.429277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ecf6c-ac56-4029-88b5-bb3e8b6ead6b None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:01.429845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ecf6c-ac56-4029-88b5-bb3e8b6ead6b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:01.429845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ecf6c-ac56-4029-88b5-bb3e8b6ead6b None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:01.431240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 706/1395] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:01.436403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e818c4-6a0a-4d28-8478-450319d566cf None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:01.437161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e818c4-6a0a-4d28-8478-450319d566cf None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:01.437444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e818c4-6a0a-4d28-8478-450319d566cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:01.456452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b8e818c4-6a0a-4d28-8478-450319d566cf None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:01.457652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b8e818c4-6a0a-4d28-8478-450319d566cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:01.465973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 690/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:01.522365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691355-4e9b-44a3-a748-8fe0045a1cf6 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:01.522773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691355-4e9b-44a3-a748-8fe0045a1cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:01.523089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691355-4e9b-44a3-a748-8fe0045a1cf6 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:01.524518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 707/1397] 10.222.0.43 () {54 vars in 962 bytes} [Thu Apr 28 16:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:01.529796 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f4e43-2651-42cb-a2e9-b6cd8c8f6d49 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:01.530166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f4e43-2651-42cb-a2e9-b6cd8c8f6d49 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:01.530528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f4e43-2651-42cb-a2e9-b6cd8c8f6d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:01.578360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b53f4e43-2651-42cb-a2e9-b6cd8c8f6d49 None None] MFA Rules not processed for user `63f2a360a89548208edd5fdff1a04e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:01.579586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b53f4e43-2651-42cb-a2e9-b6cd8c8f6d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:01.641261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 691/1398] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Apr 28 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:01.648989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691355-4e9b-44a3-a748-8fe0045a1cf6 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:01.660185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691355-4e9b-44a3-a748-8fe0045a1cf6 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:01.663733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0f453-a5fa-4455-9aac-45ceeea9833b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f2a360a89548208edd5fdff1a04e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:01.664476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0f453-a5fa-4455-9aac-45ceeea9833b service glance] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:01.664855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0f453-a5fa-4455-9aac-45ceeea9833b service glance] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:01.665141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0f453-a5fa-4455-9aac-45ceeea9833b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:01.674945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0f453-a5fa-4455-9aac-45ceeea9833b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:01.676486 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0f453-a5fa-4455-9aac-45ceeea9833b service glance] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:01.685918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 708/1399] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:02.302175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4facab-3213-4332-9a47-50c3e9b6d779 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:02.302558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4facab-3213-4332-9a47-50c3e9b6d779 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:02.302967 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4facab-3213-4332-9a47-50c3e9b6d779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:02.353413 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-bd4facab-3213-4332-9a47-50c3e9b6d779 None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:02.354640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bd4facab-3213-4332-9a47-50c3e9b6d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:02.418971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 692/1400] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:02.462343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1972-e8c3-40de-a868-7975efb22f34 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:02.462947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1972-e8c3-40de-a868-7975efb22f34 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:02.463116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1972-e8c3-40de-a868-7975efb22f34 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:02.466486 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 709/1401] 10.222.0.43 () {54 vars in 942 bytes} [Thu Apr 28 16:31:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:02.473614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2f70-f9d6-479e-9a36-a33827611b2d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:02.474108 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2f70-f9d6-479e-9a36-a33827611b2d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:02.474190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2f70-f9d6-479e-9a36-a33827611b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:02.521894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6afa2f70-f9d6-479e-9a36-a33827611b2d None None] MFA Rules not processed for user `6f397f35533540c6b92f0f4fe220d565`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:02.523148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6afa2f70-f9d6-479e-9a36-a33827611b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:02.598384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 693/1402] 10.222.0.43 () {58 vars in 1039 bytes} [Thu Apr 28 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:02.607689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da1972-e8c3-40de-a868-7975efb22f34 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:02.620720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da1972-e8c3-40de-a868-7975efb22f34 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:02.625576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5b149-780d-4aac-ab6e-6d16839c821a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:02.626208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b149-780d-4aac-ab6e-6d16839c821a service swift] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:02.626492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b149-780d-4aac-ab6e-6d16839c821a service swift] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:02.627301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b149-780d-4aac-ab6e-6d16839c821a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:02.635304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5b149-780d-4aac-ab6e-6d16839c821a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:02.636943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5b149-780d-4aac-ab6e-6d16839c821a service swift] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:02.646640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 710/1403] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:31:02.750363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48816f77-e747-453d-b3ea-11a98196cf0f None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:02.752771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48816f77-e747-453d-b3ea-11a98196cf0f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:02.753086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48816f77-e747-453d-b3ea-11a98196cf0f None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:02.756159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 694/1404] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:31:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:02.761572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a752d-2b18-477d-8077-103cea21eef4 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:02.761868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a752d-2b18-477d-8077-103cea21eef4 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:02.762154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a752d-2b18-477d-8077-103cea21eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:02.782099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-cb2a752d-2b18-477d-8077-103cea21eef4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:02.783370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cb2a752d-2b18-477d-8077-103cea21eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:02.791390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 711/1405] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:02.836820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48816f77-e747-453d-b3ea-11a98196cf0f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:02.852926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48816f77-e747-453d-b3ea-11a98196cf0f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:02.859312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078c010-aab2-4b12-87ee-c009c4ea1675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:02.860014 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078c010-aab2-4b12-87ee-c009c4ea1675 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:02.860368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078c010-aab2-4b12-87ee-c009c4ea1675 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:02.860633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078c010-aab2-4b12-87ee-c009c4ea1675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:02.870324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078c010-aab2-4b12-87ee-c009c4ea1675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:02.879577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078c010-aab2-4b12-87ee-c009c4ea1675 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:02.882510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 695/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:05.434797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ffb06-a2b5-46a0-8f8a-bc9e93e556d9 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:05.435385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ffb06-a2b5-46a0-8f8a-bc9e93e556d9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:05.435385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ffb06-a2b5-46a0-8f8a-bc9e93e556d9 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:05.436735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 712/1407] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:05.442272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5638684-248a-4ff5-bde7-fae656dff5ad None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:05.442785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5638684-248a-4ff5-bde7-fae656dff5ad None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:05.442877 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5638684-248a-4ff5-bde7-fae656dff5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:05.461554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e5638684-248a-4ff5-bde7-fae656dff5ad None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:05.462865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e5638684-248a-4ff5-bde7-fae656dff5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:05.472013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 696/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:05.517562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ffb06-a2b5-46a0-8f8a-bc9e93e556d9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:05.536178 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ffb06-a2b5-46a0-8f8a-bc9e93e556d9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:05.541684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc252fda-a9f6-4eec-9ca4-0665b4ec24a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:05.542617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc252fda-a9f6-4eec-9ca4-0665b4ec24a5 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:05.542906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc252fda-a9f6-4eec-9ca4-0665b4ec24a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:05.543189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc252fda-a9f6-4eec-9ca4-0665b4ec24a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:05.552702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc252fda-a9f6-4eec-9ca4-0665b4ec24a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:05.554389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc252fda-a9f6-4eec-9ca4-0665b4ec24a5 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:05.565828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 713/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:27.209319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ddc9-4b26-41c6-8b7d-63c23be68f56 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:27.209951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ddc9-4b26-41c6-8b7d-63c23be68f56 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:27.209951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1ddc9-4b26-41c6-8b7d-63c23be68f56 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:27.211286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 697/1410] 10.222.0.43 () {54 vars in 918 bytes} [Thu Apr 28 16:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:27.216680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b165e5-28df-4f2c-b767-69dbba544c62 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:27.217151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b165e5-28df-4f2c-b767-69dbba544c62 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:27.217255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b165e5-28df-4f2c-b767-69dbba544c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:27.236215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-05b165e5-28df-4f2c-b767-69dbba544c62 None None] MFA Rules not processed for user `ded012db549b45669a4ffcdd988b55ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:27.237417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-05b165e5-28df-4f2c-b767-69dbba544c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:27.245976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 714/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Apr 28 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:27.259967 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4f85-1d13-4fc3-bc17-75c034a00ab5 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:27.260258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4f85-1d13-4fc3-bc17-75c034a00ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:27.260531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4f85-1d13-4fc3-bc17-75c034a00ab5 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:27.261881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 698/1412] 10.222.0.43 () {54 vars in 918 bytes} [Thu Apr 28 16:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:27.266365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ffda-1fd3-4e44-910c-df247d58c164 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:27.266722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ffda-1fd3-4e44-910c-df247d58c164 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:27.267012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ffda-1fd3-4e44-910c-df247d58c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:27.284674 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ed60ffda-1fd3-4e44-910c-df247d58c164 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:27.285862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ed60ffda-1fd3-4e44-910c-df247d58c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:27.295279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 715/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Apr 28 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:31:29.995863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8c74-0f4a-4fd6-b4d3-09edc1115569 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:29.996408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8c74-0f4a-4fd6-b4d3-09edc1115569 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:29.996408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b8c74-0f4a-4fd6-b4d3-09edc1115569 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:29.997822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:30.003912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325cbc-23c9-4bd7-b0aa-7c920bee80d3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:30.004378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325cbc-23c9-4bd7-b0aa-7c920bee80d3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:30.004570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325cbc-23c9-4bd7-b0aa-7c920bee80d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:30.021724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b0325cbc-23c9-4bd7-b0aa-7c920bee80d3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:30.022986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b0325cbc-23c9-4bd7-b0aa-7c920bee80d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:30.030787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:30.073135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b8c74-0f4a-4fd6-b4d3-09edc1115569 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:30.087865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b8c74-0f4a-4fd6-b4d3-09edc1115569 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:30.093300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201b73b-15b2-465d-8ace-5979dec0b38f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:30.093937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b73b-15b2-465d-8ace-5979dec0b38f service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:30.094224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b73b-15b2-465d-8ace-5979dec0b38f service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:30.094500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201b73b-15b2-465d-8ace-5979dec0b38f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:30.102407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201b73b-15b2-465d-8ace-5979dec0b38f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:30.104016 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201b73b-15b2-465d-8ace-5979dec0b38f service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:30.113720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 700/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:31.450823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3194aaa-1bbe-495d-808f-9447f0c56864 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:31.451397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3194aaa-1bbe-495d-808f-9447f0c56864 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:31.451397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3194aaa-1bbe-495d-808f-9447f0c56864 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:31.452817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:31.458292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cf5c0-3726-4718-8f68-6dc891e43706 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:31.458748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cf5c0-3726-4718-8f68-6dc891e43706 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:31.458883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cf5c0-3726-4718-8f68-6dc891e43706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:31.477959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-584cf5c0-3726-4718-8f68-6dc891e43706 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:31.479178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-584cf5c0-3726-4718-8f68-6dc891e43706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:31.486934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:31.654993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3194aaa-1bbe-495d-808f-9447f0c56864 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:31.669489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3194aaa-1bbe-495d-808f-9447f0c56864 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:31.675284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bcab8-b829-4e97-9f41-9aa1387c45cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:31.675924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bcab8-b829-4e97-9f41-9aa1387c45cd service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:31.676206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bcab8-b829-4e97-9f41-9aa1387c45cd service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:31.676487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bcab8-b829-4e97-9f41-9aa1387c45cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:31.684690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bcab8-b829-4e97-9f41-9aa1387c45cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:31.686275 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bcab8-b829-4e97-9f41-9aa1387c45cd service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:31.696167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 718/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:32.960558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7eed-fd72-494f-ba93-2812f0a9f7f9 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:32.961134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7eed-fd72-494f-ba93-2812f0a9f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:32.961134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e7eed-fd72-494f-ba93-2812f0a9f7f9 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:32.962496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:32.967360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add873d0-176d-4a7d-b17b-7ee0ab9a8747 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:32.967793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add873d0-176d-4a7d-b17b-7ee0ab9a8747 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:32.967936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add873d0-176d-4a7d-b17b-7ee0ab9a8747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:32.986106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-add873d0-176d-4a7d-b17b-7ee0ab9a8747 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:32.987353 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-add873d0-176d-4a7d-b17b-7ee0ab9a8747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:32.995828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:33.144838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e7eed-fd72-494f-ba93-2812f0a9f7f9 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:33.159060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e7eed-fd72-494f-ba93-2812f0a9f7f9 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:33.164375 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e96d0f-ef5b-49e0-aed2-2264675f4393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:33.165007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e96d0f-ef5b-49e0-aed2-2264675f4393 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:33.165300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e96d0f-ef5b-49e0-aed2-2264675f4393 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:33.165574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e96d0f-ef5b-49e0-aed2-2264675f4393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:33.173651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e96d0f-ef5b-49e0-aed2-2264675f4393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:33.175259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e96d0f-ef5b-49e0-aed2-2264675f4393 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:33.185383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 703/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:34.484693 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02821d-c302-488d-83d8-009a4564f163 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:34.485742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02821d-c302-488d-83d8-009a4564f163 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:34.485742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02821d-c302-488d-83d8-009a4564f163 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:34.487188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:34.492203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d16ad-a141-4300-8992-48d6929c3783 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:34.492634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d16ad-a141-4300-8992-48d6929c3783 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:34.492800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d16ad-a141-4300-8992-48d6929c3783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:34.511154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-842d16ad-a141-4300-8992-48d6929c3783 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:34.512359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-842d16ad-a141-4300-8992-48d6929c3783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:34.520456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:31:34.676190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02821d-c302-488d-83d8-009a4564f163 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:34.690111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02821d-c302-488d-83d8-009a4564f163 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:34.695537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136d406-9449-4e3e-b8ca-cc132fd79057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:34.696173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d406-9449-4e3e-b8ca-cc132fd79057 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:34.696460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d406-9449-4e3e-b8ca-cc132fd79057 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:34.696746 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136d406-9449-4e3e-b8ca-cc132fd79057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:34.704798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136d406-9449-4e3e-b8ca-cc132fd79057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:34.706385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136d406-9449-4e3e-b8ca-cc132fd79057 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:34.715835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 721/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:36.006288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067d8d7-07b8-4085-8f2f-a5ec771a05ee None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:36.006859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067d8d7-07b8-4085-8f2f-a5ec771a05ee None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:36.007088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067d8d7-07b8-4085-8f2f-a5ec771a05ee None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:36.008772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:36.016014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461df07-8884-4a75-a684-b3ee569e06ae None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:36.017038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461df07-8884-4a75-a684-b3ee569e06ae None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:36.017130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461df07-8884-4a75-a684-b3ee569e06ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:36.035887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4461df07-8884-4a75-a684-b3ee569e06ae None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:36.037116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4461df07-8884-4a75-a684-b3ee569e06ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:36.045659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:36.205021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067d8d7-07b8-4085-8f2f-a5ec771a05ee None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:36.219037 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067d8d7-07b8-4085-8f2f-a5ec771a05ee None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:36.224357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3bf01-d34a-4ca1-80c6-1aa0451e944d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:36.224986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bf01-d34a-4ca1-80c6-1aa0451e944d service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:36.225268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bf01-d34a-4ca1-80c6-1aa0451e944d service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:36.225542 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3bf01-d34a-4ca1-80c6-1aa0451e944d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:36.233483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3bf01-d34a-4ca1-80c6-1aa0451e944d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:36.235091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3bf01-d34a-4ca1-80c6-1aa0451e944d service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:36.244326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 706/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:37.504475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260b32e-9c41-4858-90f0-bca56926a0d9 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:37.505054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260b32e-9c41-4858-90f0-bca56926a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:37.505054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260b32e-9c41-4858-90f0-bca56926a0d9 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:37.506408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:37.511398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7437e-6bc9-42f5-a4d7-0fc5776f1386 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:37.511812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7437e-6bc9-42f5-a4d7-0fc5776f1386 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:37.511950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7437e-6bc9-42f5-a4d7-0fc5776f1386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:37.529952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-07c7437e-6bc9-42f5-a4d7-0fc5776f1386 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:37.531196 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-07c7437e-6bc9-42f5-a4d7-0fc5776f1386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:37.540255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:31:37.697798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260b32e-9c41-4858-90f0-bca56926a0d9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:37.715013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260b32e-9c41-4858-90f0-bca56926a0d9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:37.720598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664fee-0b67-4c90-b0f1-38f5eb05faf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:37.721253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664fee-0b67-4c90-b0f1-38f5eb05faf7 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:37.721541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664fee-0b67-4c90-b0f1-38f5eb05faf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:37.721823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664fee-0b67-4c90-b0f1-38f5eb05faf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:37.732583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a664fee-0b67-4c90-b0f1-38f5eb05faf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:37.734179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a664fee-0b67-4c90-b0f1-38f5eb05faf7 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:37.743763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 724/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:39.046736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005106-a0b5-4965-b185-9c393ac212f0 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:39.047278 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005106-a0b5-4965-b185-9c393ac212f0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:39.047368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005106-a0b5-4965-b185-9c393ac212f0 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:39.049352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:39.054161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562813c1-5fe9-48e6-99ac-d60cddd93aae None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:39.054583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562813c1-5fe9-48e6-99ac-d60cddd93aae None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:39.054750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562813c1-5fe9-48e6-99ac-d60cddd93aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:39.072884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-562813c1-5fe9-48e6-99ac-d60cddd93aae None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:39.074079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-562813c1-5fe9-48e6-99ac-d60cddd93aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:39.081865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:39.231578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005106-a0b5-4965-b185-9c393ac212f0 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:39.246671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005106-a0b5-4965-b185-9c393ac212f0 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:39.252256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b4bc-4e25-435f-bae3-f00214724470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:39.252881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b4bc-4e25-435f-bae3-f00214724470 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:39.253163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b4bc-4e25-435f-bae3-f00214724470 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:39.253438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b4bc-4e25-435f-bae3-f00214724470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:39.262197 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b4bc-4e25-435f-bae3-f00214724470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:39.263804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b4bc-4e25-435f-bae3-f00214724470 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:39.273168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 709/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:40.526202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496106-9968-4004-b92a-178d3f7152e7 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:40.526794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496106-9968-4004-b92a-178d3f7152e7 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:40.526794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496106-9968-4004-b92a-178d3f7152e7 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:40.528156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:40.533626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35ed2-5c4f-4829-a6d0-b4f9b74359db None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:40.534053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35ed2-5c4f-4829-a6d0-b4f9b74359db None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:40.534216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35ed2-5c4f-4829-a6d0-b4f9b74359db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:40.552063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f7f35ed2-5c4f-4829-a6d0-b4f9b74359db None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:40.553264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f7f35ed2-5c4f-4829-a6d0-b4f9b74359db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:40.561148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:40.710260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496106-9968-4004-b92a-178d3f7152e7 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:40.724246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496106-9968-4004-b92a-178d3f7152e7 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:40.729633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbd078-7996-4e87-82a3-01d55235257a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:40.730269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbd078-7996-4e87-82a3-01d55235257a service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:40.730577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbd078-7996-4e87-82a3-01d55235257a service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:40.730863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbd078-7996-4e87-82a3-01d55235257a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:40.739031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbd078-7996-4e87-82a3-01d55235257a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:40.740624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cbd078-7996-4e87-82a3-01d55235257a service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:40.749855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 727/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:42.014754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1e332-2838-451f-a7c1-b5050f877f1e None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:42.015362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1e332-2838-451f-a7c1-b5050f877f1e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:42.015362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1e332-2838-451f-a7c1-b5050f877f1e None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:42.017237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:42.022249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4c11-dfbf-44f2-9bef-d5e4be4ada8b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:42.022691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4c11-dfbf-44f2-9bef-d5e4be4ada8b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:42.022845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4c11-dfbf-44f2-9bef-d5e4be4ada8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:42.041030 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-0d7c4c11-dfbf-44f2-9bef-d5e4be4ada8b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:42.042506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0d7c4c11-dfbf-44f2-9bef-d5e4be4ada8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:42.050434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:42.197842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1e332-2838-451f-a7c1-b5050f877f1e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:42.212674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1e332-2838-451f-a7c1-b5050f877f1e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:42.217916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83819e1-af06-4446-ad67-a7725559aa13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:42.218571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83819e1-af06-4446-ad67-a7725559aa13 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:42.218858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83819e1-af06-4446-ad67-a7725559aa13 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:42.219135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83819e1-af06-4446-ad67-a7725559aa13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:42.227058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83819e1-af06-4446-ad67-a7725559aa13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:42.228622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83819e1-af06-4446-ad67-a7725559aa13 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:42.237794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 712/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:44.382569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b61a-eb6d-4cc3-b7f8-15379bb44dc6 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:44.383098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b61a-eb6d-4cc3-b7f8-15379bb44dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:44.383098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b61a-eb6d-4cc3-b7f8-15379bb44dc6 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:44.384487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:44.389885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b1f5-366c-43ca-8b49-68fbd27d820d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:44.390356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b1f5-366c-43ca-8b49-68fbd27d820d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:44.390471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4b1f5-366c-43ca-8b49-68fbd27d820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:44.417178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f9b4b1f5-366c-43ca-8b49-68fbd27d820d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:44.424509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f9b4b1f5-366c-43ca-8b49-68fbd27d820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:44.426962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:44.466114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024b61a-eb6d-4cc3-b7f8-15379bb44dc6 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:44.476746 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024b61a-eb6d-4cc3-b7f8-15379bb44dc6 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:44.480288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9c15e-7f35-4308-bae3-0279e22a470a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:44.480920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9c15e-7f35-4308-bae3-0279e22a470a service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:44.481203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9c15e-7f35-4308-bae3-0279e22a470a service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:44.481478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9c15e-7f35-4308-bae3-0279e22a470a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:44.491092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9c15e-7f35-4308-bae3-0279e22a470a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:44.492562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9c15e-7f35-4308-bae3-0279e22a470a service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:44.502568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 730/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:46.912369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bef480-4a4e-4837-9c62-cdaa538d47fa None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:46.912985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bef480-4a4e-4837-9c62-cdaa538d47fa None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:46.912985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bef480-4a4e-4837-9c62-cdaa538d47fa None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:46.914348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:46.920003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6b19-4b4e-45a7-87b2-5d0d84745539 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:46.920482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6b19-4b4e-45a7-87b2-5d0d84745539 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:46.920588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6b19-4b4e-45a7-87b2-5d0d84745539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:46.939273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-029d6b19-4b4e-45a7-87b2-5d0d84745539 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:46.940484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-029d6b19-4b4e-45a7-87b2-5d0d84745539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:46.948356 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:31:46.987702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bef480-4a4e-4837-9c62-cdaa538d47fa None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:46.998310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bef480-4a4e-4837-9c62-cdaa538d47fa None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:47.001867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e15eb-ca48-4a29-85bc-082a00292026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:47.002502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e15eb-ca48-4a29-85bc-082a00292026 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:47.002820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e15eb-ca48-4a29-85bc-082a00292026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:47.003099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e15eb-ca48-4a29-85bc-082a00292026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:47.011799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e15eb-ca48-4a29-85bc-082a00292026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:47.013347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e15eb-ca48-4a29-85bc-082a00292026 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:47.023036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 715/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:49.763588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc31c-3f11-49fd-89eb-d0ed78e398d3 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:49.764176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc31c-3f11-49fd-89eb-d0ed78e398d3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:49.764176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc31c-3f11-49fd-89eb-d0ed78e398d3 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:49.765528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:49.772420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0496b-8984-45bd-825b-71dca91a6692 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:49.777643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0496b-8984-45bd-825b-71dca91a6692 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:49.777643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0496b-8984-45bd-825b-71dca91a6692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:49.791495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-c0d0496b-8984-45bd-825b-71dca91a6692 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:49.792718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c0d0496b-8984-45bd-825b-71dca91a6692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:49.800777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:49.839709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc31c-3f11-49fd-89eb-d0ed78e398d3 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:49.850257 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc31c-3f11-49fd-89eb-d0ed78e398d3 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:49.853801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616bf5-d4b5-4c16-af79-91d97efd0f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:49.854440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616bf5-d4b5-4c16-af79-91d97efd0f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:49.854748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616bf5-d4b5-4c16-af79-91d97efd0f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:49.855024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616bf5-d4b5-4c16-af79-91d97efd0f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:49.863948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616bf5-d4b5-4c16-af79-91d97efd0f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:49.865372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea616bf5-d4b5-4c16-af79-91d97efd0f5e service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:49.874788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 733/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:52.388464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19edc8-c0f9-4647-a8c8-4811915c4a09 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:52.389002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19edc8-c0f9-4647-a8c8-4811915c4a09 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:52.389002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19edc8-c0f9-4647-a8c8-4811915c4a09 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:52.390391 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:52.395738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093dbad-1148-45fe-aba3-c64762712622 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:52.396168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093dbad-1148-45fe-aba3-c64762712622 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:52.396369 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093dbad-1148-45fe-aba3-c64762712622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:52.413833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1093dbad-1148-45fe-aba3-c64762712622 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:52.415076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1093dbad-1148-45fe-aba3-c64762712622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:52.423882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:52.463655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19edc8-c0f9-4647-a8c8-4811915c4a09 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:52.474373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19edc8-c0f9-4647-a8c8-4811915c4a09 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:52.477947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaca574-fb15-4622-bcc0-5efe202ccea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:52.478627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca574-fb15-4622-bcc0-5efe202ccea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:52.478912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca574-fb15-4622-bcc0-5efe202ccea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:52.479185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaca574-fb15-4622-bcc0-5efe202ccea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:52.488768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaca574-fb15-4622-bcc0-5efe202ccea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:52.490193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaca574-fb15-4622-bcc0-5efe202ccea0 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:52.500315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 718/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:54.827598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654439-cd40-402e-a3ed-e479f6fa21cb None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:54.828163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654439-cd40-402e-a3ed-e479f6fa21cb None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:54.828163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654439-cd40-402e-a3ed-e479f6fa21cb None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:54.829567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:54.834780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f5b4-f7ff-41af-b0fb-e008ea914256 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:54.835213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f5b4-f7ff-41af-b0fb-e008ea914256 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:54.835348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f5b4-f7ff-41af-b0fb-e008ea914256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:54.853343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1481f5b4-f7ff-41af-b0fb-e008ea914256 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:54.854574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1481f5b4-f7ff-41af-b0fb-e008ea914256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:54.863038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:54.901003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da654439-cd40-402e-a3ed-e479f6fa21cb None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:54.912041 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da654439-cd40-402e-a3ed-e479f6fa21cb None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:54.915568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19552818-3f47-45eb-b882-15fa34963f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:54.916458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19552818-3f47-45eb-b882-15fa34963f56 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:54.916741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19552818-3f47-45eb-b882-15fa34963f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:54.917020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19552818-3f47-45eb-b882-15fa34963f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:54.926689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19552818-3f47-45eb-b882-15fa34963f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:54.928134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19552818-3f47-45eb-b882-15fa34963f56 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:54.937780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 736/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:57.257764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fea446-0b15-4045-bba7-7c0cf547c42a None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:57.258295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fea446-0b15-4045-bba7-7c0cf547c42a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:57.258405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fea446-0b15-4045-bba7-7c0cf547c42a None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:57.259734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:57.264907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fd468-b38c-40f4-8b3f-cd2f6ece9f53 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:57.265372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fd468-b38c-40f4-8b3f-cd2f6ece9f53 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:57.265476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fd468-b38c-40f4-8b3f-cd2f6ece9f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:57.283311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f08fd468-b38c-40f4-8b3f-cd2f6ece9f53 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:57.284497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f08fd468-b38c-40f4-8b3f-cd2f6ece9f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:57.292637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:31:57.330062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fea446-0b15-4045-bba7-7c0cf547c42a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:57.340811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fea446-0b15-4045-bba7-7c0cf547c42a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:57.344717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25297b78-050a-49cc-adf0-745ad3ccda6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:57.345884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25297b78-050a-49cc-adf0-745ad3ccda6f service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:57.346170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25297b78-050a-49cc-adf0-745ad3ccda6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:57.346451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25297b78-050a-49cc-adf0-745ad3ccda6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:57.355532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25297b78-050a-49cc-adf0-745ad3ccda6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:57.357040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25297b78-050a-49cc-adf0-745ad3ccda6f service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:57.367244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 721/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:31:59.686967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44b6a-794e-413f-b8f1-49c99e097aaa None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:59.687535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44b6a-794e-413f-b8f1-49c99e097aaa None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:59.687535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44b6a-794e-413f-b8f1-49c99e097aaa None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:59.689430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:31:59.694819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d31f44-f9b1-418c-8c73-6b9b17820a8c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:59.695320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d31f44-f9b1-418c-8c73-6b9b17820a8c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:59.695436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d31f44-f9b1-418c-8c73-6b9b17820a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:59.713314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-31d31f44-f9b1-418c-8c73-6b9b17820a8c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:31:59.714512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-31d31f44-f9b1-418c-8c73-6b9b17820a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:31:59.722400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:31:59.759996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44b6a-794e-413f-b8f1-49c99e097aaa None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:31:59.771505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44b6a-794e-413f-b8f1-49c99e097aaa None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:31:59.775109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deffba-58e2-4a49-9377-05461018069d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:31:59.775751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deffba-58e2-4a49-9377-05461018069d service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:31:59.776038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deffba-58e2-4a49-9377-05461018069d service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:31:59.776319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deffba-58e2-4a49-9377-05461018069d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:31:59.786147 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deffba-58e2-4a49-9377-05461018069d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:31:59.787639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deffba-58e2-4a49-9377-05461018069d service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:31:59.797741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 739/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:32:02.115810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377edd1-a3b6-45d8-a07a-f2de121c3b7f None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:02.116377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377edd1-a3b6-45d8-a07a-f2de121c3b7f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:02.116377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377edd1-a3b6-45d8-a07a-f2de121c3b7f None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:02.117793 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:02.124367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37deef3-d1c1-4f2e-9343-bf4855e89c6f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:02.124867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37deef3-d1c1-4f2e-9343-bf4855e89c6f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:02.124998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37deef3-d1c1-4f2e-9343-bf4855e89c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:02.143536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b37deef3-d1c1-4f2e-9343-bf4855e89c6f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:02.144751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b37deef3-d1c1-4f2e-9343-bf4855e89c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:02.152798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:02.190995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377edd1-a3b6-45d8-a07a-f2de121c3b7f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:02.201574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377edd1-a3b6-45d8-a07a-f2de121c3b7f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:02.205110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b967e0-b02a-4eb3-ae17-a8720ac97bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:02.205784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b967e0-b02a-4eb3-ae17-a8720ac97bef service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:02.206069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b967e0-b02a-4eb3-ae17-a8720ac97bef service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:02.206347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b967e0-b02a-4eb3-ae17-a8720ac97bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:02.216837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b967e0-b02a-4eb3-ae17-a8720ac97bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:02.218282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b967e0-b02a-4eb3-ae17-a8720ac97bef service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:02.229299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 724/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:32:04.548746 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa598c-193e-4c2f-9d22-cbf8d411664b None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:04.549283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa598c-193e-4c2f-9d22-cbf8d411664b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:04.549417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa598c-193e-4c2f-9d22-cbf8d411664b None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:04.550745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:04.557040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db13e-e29b-4d25-a219-4c6c9252ebce None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:04.557504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db13e-e29b-4d25-a219-4c6c9252ebce None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:04.557609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96db13e-e29b-4d25-a219-4c6c9252ebce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:04.575812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-d96db13e-e29b-4d25-a219-4c6c9252ebce None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:04.577019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d96db13e-e29b-4d25-a219-4c6c9252ebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:04.585065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:04.621508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa598c-193e-4c2f-9d22-cbf8d411664b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:04.632634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa598c-193e-4c2f-9d22-cbf8d411664b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:04.636490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712aa5-e99a-480b-8aa7-52dcb1e4e589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:04.637148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712aa5-e99a-480b-8aa7-52dcb1e4e589 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:04.637430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712aa5-e99a-480b-8aa7-52dcb1e4e589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:04.637708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712aa5-e99a-480b-8aa7-52dcb1e4e589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:04.650263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712aa5-e99a-480b-8aa7-52dcb1e4e589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:04.650574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712aa5-e99a-480b-8aa7-52dcb1e4e589 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:04.663788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 742/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:32:06.998951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bde9b-7ee8-4385-be98-e9e6963687d3 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:06.999498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bde9b-7ee8-4385-be98-e9e6963687d3 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:06.999605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bde9b-7ee8-4385-be98-e9e6963687d3 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:07.000976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:07.013763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7169-2599-41cd-a71b-ed4741734bf3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:07.014308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7169-2599-41cd-a71b-ed4741734bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:07.014308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7169-2599-41cd-a71b-ed4741734bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:07.033152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-90ad7169-2599-41cd-a71b-ed4741734bf3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:07.034393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-90ad7169-2599-41cd-a71b-ed4741734bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:07.045020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:07.082605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bde9b-7ee8-4385-be98-e9e6963687d3 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:07.093356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bde9b-7ee8-4385-be98-e9e6963687d3 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:07.096909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44331bfa-b4dc-48bf-833b-12e1d43adb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:07.097555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44331bfa-b4dc-48bf-833b-12e1d43adb12 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:07.097868 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44331bfa-b4dc-48bf-833b-12e1d43adb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:07.098126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44331bfa-b4dc-48bf-833b-12e1d43adb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:07.107357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44331bfa-b4dc-48bf-833b-12e1d43adb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:07.108789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44331bfa-b4dc-48bf-833b-12e1d43adb12 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:07.118457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 727/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:32:41.974407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c11f-60e0-49ce-81d1-475c1a30f89a None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:41.975066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c11f-60e0-49ce-81d1-475c1a30f89a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:41.975470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c11f-60e0-49ce-81d1-475c1a30f89a None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:41.977136 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 744/1471] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:41.982523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ffae-e73e-4dae-b3e6-34b79fb39169 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:41.983002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ffae-e73e-4dae-b3e6-34b79fb39169 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:41.983098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ffae-e73e-4dae-b3e6-34b79fb39169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:42.004574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-85f2ffae-e73e-4dae-b3e6-34b79fb39169 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:42.005836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-85f2ffae-e73e-4dae-b3e6-34b79fb39169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:42.013808 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 728/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:42.065075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073133c-6e94-4651-a27e-f4daf2d88984 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:42.065301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073133c-6e94-4651-a27e-f4daf2d88984 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:42.065586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073133c-6e94-4651-a27e-f4daf2d88984 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:42.067000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 745/1473] 10.222.0.43 () {54 vars in 962 bytes} [Thu Apr 28 16:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:42.073954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfbc2-57e8-487f-8d4f-3e2de357dc77 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:42.074246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfbc2-57e8-487f-8d4f-3e2de357dc77 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:42.074526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfbc2-57e8-487f-8d4f-3e2de357dc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:42.092820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9a5dfbc2-57e8-487f-8d4f-3e2de357dc77 None None] MFA Rules not processed for user `63f2a360a89548208edd5fdff1a04e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:42.094616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9a5dfbc2-57e8-487f-8d4f-3e2de357dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:42.101155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 729/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Apr 28 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:32:42.108594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073133c-6e94-4651-a27e-f4daf2d88984 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:42.119218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073133c-6e94-4651-a27e-f4daf2d88984 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:42.122857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031d513-d809-49bf-8d64-902e9dd4da51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f2a360a89548208edd5fdff1a04e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:42.123499 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031d513-d809-49bf-8d64-902e9dd4da51 service glance] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:42.123786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031d513-d809-49bf-8d64-902e9dd4da51 service glance] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:42.124063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031d513-d809-49bf-8d64-902e9dd4da51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:42.133864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031d513-d809-49bf-8d64-902e9dd4da51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:42.135359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031d513-d809-49bf-8d64-902e9dd4da51 service glance] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:42.145458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 746/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:32:44.488921 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844551d9-b66e-4474-8552-5681e1de8f85 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:44.489463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844551d9-b66e-4474-8552-5681e1de8f85 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:44.489582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844551d9-b66e-4474-8552-5681e1de8f85 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:44.490930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 730/1476] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:32:44.496389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcfcbb-fcfd-4452-9d72-8cc802017ae2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:44.496885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcfcbb-fcfd-4452-9d72-8cc802017ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:44.497051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcfcbb-fcfd-4452-9d72-8cc802017ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:44.515426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d5fcfcbb-fcfd-4452-9d72-8cc802017ae2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:44.517201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d5fcfcbb-fcfd-4452-9d72-8cc802017ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:44.525255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 747/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:44.548924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844551d9-b66e-4474-8552-5681e1de8f85 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:44.561576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844551d9-b66e-4474-8552-5681e1de8f85 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:44.566628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af08d3-6443-432a-b696-81a63e8845ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:44.567296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af08d3-6443-432a-b696-81a63e8845ee admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:44.567561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af08d3-6443-432a-b696-81a63e8845ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:44.567840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af08d3-6443-432a-b696-81a63e8845ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:44.568582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af08d3-6443-432a-b696-81a63e8845ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:44.570358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING py.warnings [None req-47af08d3-6443-432a-b696-81a63e8845ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:32:44.570358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: warnings.warn(msg) Apr 28 16:32:44.570358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: Apr 28 16:32:44.571537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af08d3-6443-432a-b696-81a63e8845ee admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:44.591745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 731/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Apr 28 16:32:44 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:32:46.923512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d3d1-2239-4037-b1b0-669866aa0a9d None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:46.924082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d3d1-2239-4037-b1b0-669866aa0a9d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:46.924082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d3d1-2239-4037-b1b0-669866aa0a9d None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:46.925458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 748/1479] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:46.930628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee7b3-98ac-4f68-b9eb-8e473a0293db None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:46.931023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee7b3-98ac-4f68-b9eb-8e473a0293db None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:46.931200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee7b3-98ac-4f68-b9eb-8e473a0293db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:46.949875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-090ee7b3-98ac-4f68-b9eb-8e473a0293db None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:46.951158 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-090ee7b3-98ac-4f68-b9eb-8e473a0293db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:46.959634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 732/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:47.001655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17d3d1-2239-4037-b1b0-669866aa0a9d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:47.015888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17d3d1-2239-4037-b1b0-669866aa0a9d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:47.021306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dceb6-7269-4a39-9ede-098231a4fafe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:47.021943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dceb6-7269-4a39-9ede-098231a4fafe service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:47.022231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dceb6-7269-4a39-9ede-098231a4fafe service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:47.022509 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dceb6-7269-4a39-9ede-098231a4fafe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:47.030471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dceb6-7269-4a39-9ede-098231a4fafe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:47.032242 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dceb6-7269-4a39-9ede-098231a4fafe service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:47.041927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 749/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:32:49.518022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9e3c5-fc00-4c26-bf7b-86eb10a18edf None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:49.518651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9e3c5-fc00-4c26-bf7b-86eb10a18edf None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:49.518651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9e3c5-fc00-4c26-bf7b-86eb10a18edf None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:49.519972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 733/1482] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:49.525274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1c410-b295-48b6-9276-88dd901f4b32 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:49.525764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1c410-b295-48b6-9276-88dd901f4b32 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:49.525870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1c410-b295-48b6-9276-88dd901f4b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:49.543595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-6db1c410-b295-48b6-9276-88dd901f4b32 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:49.544797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6db1c410-b295-48b6-9276-88dd901f4b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:49.553144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 750/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:49.588772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9e3c5-fc00-4c26-bf7b-86eb10a18edf None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:49.599862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9e3c5-fc00-4c26-bf7b-86eb10a18edf None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:49.603460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd14ad-a799-49bb-9d7c-783034ee2033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:49.604102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd14ad-a799-49bb-9d7c-783034ee2033 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:49.604390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd14ad-a799-49bb-9d7c-783034ee2033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:49.604667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd14ad-a799-49bb-9d7c-783034ee2033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:49.614340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd14ad-a799-49bb-9d7c-783034ee2033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:49.615822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd14ad-a799-49bb-9d7c-783034ee2033 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:49.625078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 734/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:32:51.926297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efee61-6c8d-415d-a1ac-249a4df931d8 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:51.926893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efee61-6c8d-415d-a1ac-249a4df931d8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:51.926893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efee61-6c8d-415d-a1ac-249a4df931d8 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:51.928258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 751/1485] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:51.933344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dede9-5e4d-45a2-baaf-d6025689d778 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:51.933745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dede9-5e4d-45a2-baaf-d6025689d778 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:51.933907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dede9-5e4d-45a2-baaf-d6025689d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:51.951610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-473dede9-5e4d-45a2-baaf-d6025689d778 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:51.952806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-473dede9-5e4d-45a2-baaf-d6025689d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:51.961286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 735/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:51.997828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efee61-6c8d-415d-a1ac-249a4df931d8 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:52.008923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efee61-6c8d-415d-a1ac-249a4df931d8 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:52.012471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f88772-17e2-4631-a4e1-664f774309cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:52.013101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f88772-17e2-4631-a4e1-664f774309cb service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:52.013387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f88772-17e2-4631-a4e1-664f774309cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:52.013664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f88772-17e2-4631-a4e1-664f774309cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:52.023095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f88772-17e2-4631-a4e1-664f774309cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:52.024527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f88772-17e2-4631-a4e1-664f774309cb service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:52.033799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 752/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:32:54.489256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8dc5f-c4f7-4fc1-b1da-914e43cda708 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:54.489805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8dc5f-c4f7-4fc1-b1da-914e43cda708 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:54.489805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8dc5f-c4f7-4fc1-b1da-914e43cda708 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:54.491210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 736/1488] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:54.496510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d44f-00a4-42cb-bf02-042b39aca6be None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:54.496964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d44f-00a4-42cb-bf02-042b39aca6be None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:54.497073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d44f-00a4-42cb-bf02-042b39aca6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:54.514403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ec79d44f-00a4-42cb-bf02-042b39aca6be None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:54.516269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ec79d44f-00a4-42cb-bf02-042b39aca6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:54.524146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 753/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:54.564054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8dc5f-c4f7-4fc1-b1da-914e43cda708 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:54.574368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8dc5f-c4f7-4fc1-b1da-914e43cda708 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:54.577852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29729beb-ec33-4480-ab86-4d34a332eb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:54.579027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729beb-ec33-4480-ab86-4d34a332eb2b service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:54.579312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729beb-ec33-4480-ab86-4d34a332eb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:54.579585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29729beb-ec33-4480-ab86-4d34a332eb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:54.588230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29729beb-ec33-4480-ab86-4d34a332eb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:54.589641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29729beb-ec33-4480-ab86-4d34a332eb2b service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:54.599393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 737/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:32:57.336101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052fe5-c791-4be6-abad-56419aa3209c None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:57.336644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052fe5-c791-4be6-abad-56419aa3209c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:57.336741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db052fe5-c791-4be6-abad-56419aa3209c None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:57.338047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 754/1491] 10.222.0.43 () {54 vars in 926 bytes} [Thu Apr 28 16:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:32:57.343380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508eb9-4a1c-48a8-bafb-e6f85dd4b6ee None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:57.344297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508eb9-4a1c-48a8-bafb-e6f85dd4b6ee None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:57.344397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a508eb9-4a1c-48a8-bafb-e6f85dd4b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:57.362311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5a508eb9-4a1c-48a8-bafb-e6f85dd4b6ee None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:32:57.363529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5a508eb9-4a1c-48a8-bafb-e6f85dd4b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:32:57.371521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 738/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Apr 28 16:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:32:57.412248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052fe5-c791-4be6-abad-56419aa3209c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:32:57.423684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db052fe5-c791-4be6-abad-56419aa3209c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:32:57.427295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15a14a-3116-4860-b699-ddb572c55874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:32:57.427932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a14a-3116-4860-b699-ddb572c55874 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:32:57.428222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a14a-3116-4860-b699-ddb572c55874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:32:57.428507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a14a-3116-4860-b699-ddb572c55874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:32:57.437388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15a14a-3116-4860-b699-ddb572c55874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:32:57.438846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15a14a-3116-4860-b699-ddb572c55874 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:32:57.448064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 755/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:34:51.995555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36321847-a0fa-44e9-9694-1903b956a33e None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:51.996147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36321847-a0fa-44e9-9694-1903b956a33e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:51.996147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36321847-a0fa-44e9-9694-1903b956a33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.013654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-36321847-a0fa-44e9-9694-1903b956a33e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:34:52.014869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-36321847-a0fa-44e9-9694-1903b956a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:34:52.022992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 739/1494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:34:52.030936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc108f9e-a668-4d2e-abce-2f7d7deab913 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.031890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc108f9e-a668-4d2e-abce-2f7d7deab913 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.032147 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc108f9e-a668-4d2e-abce-2f7d7deab913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.050619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-dc108f9e-a668-4d2e-abce-2f7d7deab913 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:34:52.051830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-dc108f9e-a668-4d2e-abce-2f7d7deab913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:34:52.060094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 756/1495] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:34:52.065070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36321847-a0fa-44e9-9694-1903b956a33e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:52.074752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36321847-a0fa-44e9-9694-1903b956a33e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:52.079353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:52.080002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.080286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.080553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.081282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:34:52.081586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:52.082617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING py.warnings [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:34:52.082617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: warnings.warn(msg) Apr 28 16:34:52.082617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: Apr 28 16:34:52.083510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:52.095046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 740/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:34:52.102825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc108f9e-a668-4d2e-abce-2f7d7deab913 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:52.112770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc108f9e-a668-4d2e-abce-2f7d7deab913 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:52.117381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:52.118035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.118323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.118659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.119347 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:52.121095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING py.warnings [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:34:52.121095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: warnings.warn(msg) Apr 28 16:34:52.121095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: Apr 28 16:34:52.122306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:52.254645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 757/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:34:52 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:34:52.261954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:52.272543 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d3c88-5be4-417d-86ee-dd943d86b3d8 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:52.327732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:52.328906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.329194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.329470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.330171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:52.331294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING py.warnings [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:34:52.331294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: warnings.warn(msg) Apr 28 16:34:52.331294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: Apr 28 16:34:52.332497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:52.396126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 741/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:34:52 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:34:52.400444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:52.411265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba1831-7491-4bc9-a3bf-7be94840074f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:52.416098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:52.416758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.417045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.417421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.418141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:52.419194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING py.warnings [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:34:52.419194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: warnings.warn(msg) Apr 28 16:34:52.419194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: Apr 28 16:34:52.420082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:52.432770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 758/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:34:52.436598 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:52.446703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec335a-387e-411c-a27c-3fb861802ce5 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:52.451276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88e912-0fad-4dba-b16a-30a0557bbc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:52.451942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e912-0fad-4dba-b16a-30a0557bbc64 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.452232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e912-0fad-4dba-b16a-30a0557bbc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.452513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e912-0fad-4dba-b16a-30a0557bbc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.453737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88e912-0fad-4dba-b16a-30a0557bbc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:52.454832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING py.warnings [None req-de88e912-0fad-4dba-b16a-30a0557bbc64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:34:52.454832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: warnings.warn(msg) Apr 28 16:34:52.454832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: Apr 28 16:34:52.455729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88e912-0fad-4dba-b16a-30a0557bbc64 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:52.469387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 742/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:34:52.473615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:52.483413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91b75-5684-402a-a762-e2c8ba7cb0c5 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:52.487948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:52.488821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.489102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.489405 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] PATH_INFO: `/v3/projects/25b70036dea540a89f850fe3b8d0d1e0/users/f9d6749c74954ce09eb964b75c6c5f3b/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.504341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b70036dea540a89f850fe3b8d0d1e0, user_id=f9d6749c74954ce09eb964b75c6c5f3b, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:52.505423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING py.warnings [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:34:52.505423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: warnings.warn(msg) Apr 28 16:34:52.505423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: Apr 28 16:34:52.507388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:52.583996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 759/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:34:52 2022] PUT /identity/v3/projects/25b70036dea540a89f850fe3b8d0d1e0/users/f9d6749c74954ce09eb964b75c6c5f3b/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:34:52.594953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb93b6-e180-465d-82a4-bbf2478c732c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.595254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb93b6-e180-465d-82a4-bbf2478c732c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.595539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb93b6-e180-465d-82a4-bbf2478c732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.621145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-adfb93b6-e180-465d-82a4-bbf2478c732c None None] MFA Rules not processed for user `f9d6749c74954ce09eb964b75c6c5f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:34:52.622368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-adfb93b6-e180-465d-82a4-bbf2478c732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:34:52.683096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 743/1502] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:34:52.694501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:52.760984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e41320-92a4-4d24-af6b-0c0c71660f7e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:52.766843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3e59-4a63-4a19-bc11-e904986dc1ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:52.767478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3e59-4a63-4a19-bc11-e904986dc1ac service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.767761 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3e59-4a63-4a19-bc11-e904986dc1ac service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.768038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3e59-4a63-4a19-bc11-e904986dc1ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.775512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb3e59-4a63-4a19-bc11-e904986dc1ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:52.777100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb3e59-4a63-4a19-bc11-e904986dc1ac service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:52.785566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 760/1503] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:34:52.855475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23374-7f36-479c-9b67-529b8de4d467 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.855772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23374-7f36-479c-9b67-529b8de4d467 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.856055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded23374-7f36-479c-9b67-529b8de4d467 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.857343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 744/1504] 10.222.0.43 () {52 vars in 829 bytes} [Thu Apr 28 16:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:34:52.860808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3e59-4a63-4a19-bc11-e904986dc1ac service nova] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:52.920923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3e59-4a63-4a19-bc11-e904986dc1ac service nova] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:52.926393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:52.927341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:52.927623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:52.927922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] PATH_INFO: `/v3/users/f9d6749c74954ce09eb964b75c6c5f3b` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:52.929112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d6749c74954ce09eb964b75c6c5f3b)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:52.930130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING py.warnings [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:34:52.930130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: warnings.warn(msg) Apr 28 16:34:52.930130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: Apr 28 16:34:52.931374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:53.099802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d6749c74954ce09eb964b75c6c5f3b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:53.112677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d6749c74954ce09eb964b75c6c5f3b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:53.113456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d6749c74954ce09eb964b75c6c5f3b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:53.114079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d6749c74954ce09eb964b75c6c5f3b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:53.173285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d6749c74954ce09eb964b75c6c5f3b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:53.197440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 761/1505] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:34:52 2022] DELETE /identity/v3/users/f9d6749c74954ce09eb964b75c6c5f3b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:34:53.202039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c6e0-14e2-4e7e-8c11-bba40aa5543a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:53.202526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c6e0-14e2-4e7e-8c11-bba40aa5543a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:53.202664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663c6e0-14e2-4e7e-8c11-bba40aa5543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:53.219625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1663c6e0-14e2-4e7e-8c11-bba40aa5543a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:34:53.220820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1663c6e0-14e2-4e7e-8c11-bba40aa5543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:34:53.275887 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 745/1506] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:34:53.286654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:53.288303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:34:53.344914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c306ef-fe6d-4a3f-8065-887efcb2820b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:53.348547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f94837-1ea2-4713-9824-21b29edbfe90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:53.349193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94837-1ea2-4713-9824-21b29edbfe90 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:53.349483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94837-1ea2-4713-9824-21b29edbfe90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:53.349766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94837-1ea2-4713-9824-21b29edbfe90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:53.358580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f94837-1ea2-4713-9824-21b29edbfe90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:53.360628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f94837-1ea2-4713-9824-21b29edbfe90 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:53.370058 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 762/1507] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:34:53.843221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663c6e0-14e2-4e7e-8c11-bba40aa5543a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:34:53.847497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1663c6e0-14e2-4e7e-8c11-bba40aa5543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:34:53.857447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663c6e0-14e2-4e7e-8c11-bba40aa5543a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:34:53.862280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:34:53.863282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:34:53.863570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:34:53.863842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] PATH_INFO: `/v3/projects/25b70036dea540a89f850fe3b8d0d1e0` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:34:53.865074 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b70036dea540a89f850fe3b8d0d1e0)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:34:53.866117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING py.warnings [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:34:53.866117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: warnings.warn(msg) Apr 28 16:34:53.866117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: Apr 28 16:34:53.867328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:34:53.983976 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b70036dea540a89f850fe3b8d0d1e0', 'request_id': 'req-b52d18a7-a8a8-459e-bb22-6ba562cd6522'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:54.052932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b70036dea540a89f850fe3b8d0d1e0', 'request_id': 'req-b52d18a7-a8a8-459e-bb22-6ba562cd6522'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:54.059335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b70036dea540a89f850fe3b8d0d1e0', 'request_id': 'req-b52d18a7-a8a8-459e-bb22-6ba562cd6522'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:54.079554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] The token cache is being invalidate because project 25b70036dea540a89f850fe3b8d0d1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:34:54.081597 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:54.081597 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b52d18a7-a8a8-459e-bb22-6ba562cd6522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:34:54.082892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 746/1508] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:34:53 2022] DELETE /identity/v3/projects/25b70036dea540a89f850fe3b8d0d1e0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:36:37.405119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f3b08-176f-48c9-baa2-3a1ca0c1c38a None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:37.406027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f3b08-176f-48c9-baa2-3a1ca0c1c38a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:37.406199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f3b08-176f-48c9-baa2-3a1ca0c1c38a None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:37.407743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 763/1509] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:36:37.413275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aae5e5-84ef-494b-a073-2fd5f458eb5d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:37.413718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aae5e5-84ef-494b-a073-2fd5f458eb5d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:37.413816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aae5e5-84ef-494b-a073-2fd5f458eb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:37.431332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-92aae5e5-84ef-494b-a073-2fd5f458eb5d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:36:37.432529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-92aae5e5-84ef-494b-a073-2fd5f458eb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:37.487792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 747/1510] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:36:37.638894 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f3b08-176f-48c9-baa2-3a1ca0c1c38a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:36:37.640598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-939f3b08-176f-48c9-baa2-3a1ca0c1c38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:37.715642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f3b08-176f-48c9-baa2-3a1ca0c1c38a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:36:37.721732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677657b1-58b6-494f-9e89-ed7456182e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:36:37.722388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677657b1-58b6-494f-9e89-ed7456182e81 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:37.722694 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677657b1-58b6-494f-9e89-ed7456182e81 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:37.722980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677657b1-58b6-494f-9e89-ed7456182e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:37.731417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677657b1-58b6-494f-9e89-ed7456182e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:36:37.733046 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677657b1-58b6-494f-9e89-ed7456182e81 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:36:37.743206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 764/1511] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:36:38.352332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af5553-e794-421b-bcb3-2e7891497cfc None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:38.352630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af5553-e794-421b-bcb3-2e7891497cfc None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:38.352918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af5553-e794-421b-bcb3-2e7891497cfc None None] PATH_INFO: `/v3` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:38.354287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 748/1512] 10.222.0.49 () {54 vars in 925 bytes} [Thu Apr 28 16:36:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:36:38.360061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba0a82-d64f-4ce3-b60d-c29fa57dc9e9 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:38.364885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba0a82-d64f-4ce3-b60d-c29fa57dc9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:38.364885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba0a82-d64f-4ce3-b60d-c29fa57dc9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:38.379021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e6ba0a82-d64f-4ce3-b60d-c29fa57dc9e9 None None] MFA Rules not processed for user `ded012db549b45669a4ffcdd988b55ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:36:38.380420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e6ba0a82-d64f-4ce3-b60d-c29fa57dc9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:38.441961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 765/1513] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Apr 28 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:36:39.010568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e111963-2977-434b-ac7b-98c30479dd55 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:39.011117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e111963-2977-434b-ac7b-98c30479dd55 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:39.011234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e111963-2977-434b-ac7b-98c30479dd55 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:39.012549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:36:39.017314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e2d4-28f0-461a-abba-e1755fd26e9d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:39.017610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e2d4-28f0-461a-abba-e1755fd26e9d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:39.017890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e2d4-28f0-461a-abba-e1755fd26e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:39.036207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d8b9e2d4-28f0-461a-abba-e1755fd26e9d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:36:39.037970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d8b9e2d4-28f0-461a-abba-e1755fd26e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:39.046076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:36:39.196852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e111963-2977-434b-ac7b-98c30479dd55 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:36:39.211505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e111963-2977-434b-ac7b-98c30479dd55 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:36:39.216858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78297b8a-3071-481c-864a-136e07616627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:36:39.217484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297b8a-3071-481c-864a-136e07616627 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:39.217770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297b8a-3071-481c-864a-136e07616627 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:39.218049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297b8a-3071-481c-864a-136e07616627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:39.226104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78297b8a-3071-481c-864a-136e07616627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:36:39.227727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78297b8a-3071-481c-864a-136e07616627 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:36:39.236836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 750/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:36:42.471387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4f36-c705-479f-9133-889d3cd8c01e None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:42.471936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4f36-c705-479f-9133-889d3cd8c01e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:42.471936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee4f36-c705-479f-9133-889d3cd8c01e None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:42.473301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 767/1517] 10.222.0.43 () {54 vars in 960 bytes} [Thu Apr 28 16:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:36:42.478649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b8857-3211-4cc0-9cc2-79582af55058 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:42.479049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b8857-3211-4cc0-9cc2-79582af55058 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:42.479208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b8857-3211-4cc0-9cc2-79582af55058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:42.497259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3f4b8857-3211-4cc0-9cc2-79582af55058 None None] MFA Rules not processed for user `ded012db549b45669a4ffcdd988b55ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:36:42.498442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3f4b8857-3211-4cc0-9cc2-79582af55058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:42.506935 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 751/1518] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Apr 28 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:36:42.514134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4f36-c705-479f-9133-889d3cd8c01e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:36:42.527256 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee4f36-c705-479f-9133-889d3cd8c01e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:36:42.532404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6a9c4-2068-4d80-89be-144b4e4eaa58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded012db549b45669a4ffcdd988b55ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:36:42.533037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a9c4-2068-4d80-89be-144b4e4eaa58 service placement] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:42.533324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a9c4-2068-4d80-89be-144b4e4eaa58 service placement] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:42.533602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6a9c4-2068-4d80-89be-144b4e4eaa58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:42.542569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6a9c4-2068-4d80-89be-144b4e4eaa58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:36:42.544174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6a9c4-2068-4d80-89be-144b4e4eaa58 service placement] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:36:42.554189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 768/1519] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:36:50.842698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec230bec-bb9b-493c-8588-41794b6bff16 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:50.843264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec230bec-bb9b-493c-8588-41794b6bff16 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:50.843264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec230bec-bb9b-493c-8588-41794b6bff16 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:50.844642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 752/1520] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:36:50.849528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c2adc-3a28-4e37-b920-1cc9f02bdc28 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:50.849966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c2adc-3a28-4e37-b920-1cc9f02bdc28 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:50.850100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c2adc-3a28-4e37-b920-1cc9f02bdc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:50.868358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-eb9c2adc-3a28-4e37-b920-1cc9f02bdc28 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:36:50.869906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-eb9c2adc-3a28-4e37-b920-1cc9f02bdc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:50.877759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 769/1521] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:36:51.026370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec230bec-bb9b-493c-8588-41794b6bff16 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:36:51.040939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec230bec-bb9b-493c-8588-41794b6bff16 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:36:51.046689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ccc4b-2001-4a6b-85a4-fcbbc0ab1fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:36:51.047338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccc4b-2001-4a6b-85a4-fcbbc0ab1fee service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:51.047626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccc4b-2001-4a6b-85a4-fcbbc0ab1fee service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:51.047910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccc4b-2001-4a6b-85a4-fcbbc0ab1fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:51.056898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ccc4b-2001-4a6b-85a4-fcbbc0ab1fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:36:51.058507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ccc4b-2001-4a6b-85a4-fcbbc0ab1fee service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:36:51.067744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 753/1522] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:36:52.286153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132ba0b-0a3e-4543-b65e-2b6c57fd9ed2 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:52.286741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132ba0b-0a3e-4543-b65e-2b6c57fd9ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:52.286741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132ba0b-0a3e-4543-b65e-2b6c57fd9ed2 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:52.288723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 770/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu Apr 28 16:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:36:52.293465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17583ca-a3c3-409f-a51c-7c3303df8dda None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:52.293916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17583ca-a3c3-409f-a51c-7c3303df8dda None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:52.294107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17583ca-a3c3-409f-a51c-7c3303df8dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:52.312067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-a17583ca-a3c3-409f-a51c-7c3303df8dda None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:36:52.313288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a17583ca-a3c3-409f-a51c-7c3303df8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:52.321319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 754/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu Apr 28 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:36:52.474920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132ba0b-0a3e-4543-b65e-2b6c57fd9ed2 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:36:52.489482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132ba0b-0a3e-4543-b65e-2b6c57fd9ed2 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:36:52.494815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0cb12-0100-4694-bceb-eef4bca9a5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:36:52.495451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cb12-0100-4694-bceb-eef4bca9a5cd service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:52.495732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cb12-0100-4694-bceb-eef4bca9a5cd service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:52.496006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cb12-0100-4694-bceb-eef4bca9a5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:52.504017 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0cb12-0100-4694-bceb-eef4bca9a5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:36:52.505563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0cb12-0100-4694-bceb-eef4bca9a5cd service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:36:52.514822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 771/1525] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:36:56.813177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ec81-d205-4a87-8eaf-f582f13bb15c None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:56.813756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ec81-d205-4a87-8eaf-f582f13bb15c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:56.813756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539ec81-d205-4a87-8eaf-f582f13bb15c None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:56.815127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 755/1526] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:36:56.820753 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d615-8621-4845-9470-e624c260c683 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:56.821174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d615-8621-4845-9470-e624c260c683 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:56.821310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097d615-8621-4845-9470-e624c260c683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:56.841641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-7097d615-8621-4845-9470-e624c260c683 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:36:56.842890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-7097d615-8621-4845-9470-e624c260c683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:56.850691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 772/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:36:56.887475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539ec81-d205-4a87-8eaf-f582f13bb15c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:36:56.889149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c539ec81-d205-4a87-8eaf-f582f13bb15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:56.945355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539ec81-d205-4a87-8eaf-f582f13bb15c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:36:56.950304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edeb76-92ac-44a4-a5e7-a49d77e07e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:36:56.950304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edeb76-92ac-44a4-a5e7-a49d77e07e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:56.950304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edeb76-92ac-44a4-a5e7-a49d77e07e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:56.950304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edeb76-92ac-44a4-a5e7-a49d77e07e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:56.959381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edeb76-92ac-44a4-a5e7-a49d77e07e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:36:56.960821 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edeb76-92ac-44a4-a5e7-a49d77e07e6c service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:36:56.970342 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 756/1528] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:36:59.219747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbcf70-c50b-4f05-b9c4-92319b22fb85 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:59.220327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbcf70-c50b-4f05-b9c4-92319b22fb85 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:59.220327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbcf70-c50b-4f05-b9c4-92319b22fb85 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:59.221688 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 773/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:36:59.227631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee43c6-7638-4b0c-beaf-b0a2d912618d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:59.228051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee43c6-7638-4b0c-beaf-b0a2d912618d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:59.228209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee43c6-7638-4b0c-beaf-b0a2d912618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:59.246296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b6ee43c6-7638-4b0c-beaf-b0a2d912618d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:36:59.247600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b6ee43c6-7638-4b0c-beaf-b0a2d912618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:59.255701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 757/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:36:59.293348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbcf70-c50b-4f05-b9c4-92319b22fb85 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:36:59.295202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4acbcf70-c50b-4f05-b9c4-92319b22fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:36:59.308599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbcf70-c50b-4f05-b9c4-92319b22fb85 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:36:59.312178 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505cece-b8dc-43bf-a13c-e657a928b6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:36:59.312818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505cece-b8dc-43bf-a13c-e657a928b6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:36:59.313106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505cece-b8dc-43bf-a13c-e657a928b6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:36:59.313383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505cece-b8dc-43bf-a13c-e657a928b6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:36:59.322652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505cece-b8dc-43bf-a13c-e657a928b6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:36:59.324094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505cece-b8dc-43bf-a13c-e657a928b6d5 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:36:59.333481 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 774/1531] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:37:03.315794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd1f9-3015-44ee-8b9b-4c9d0feef374 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:37:03.316357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd1f9-3015-44ee-8b9b-4c9d0feef374 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:37:03.316486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd1f9-3015-44ee-8b9b-4c9d0feef374 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:37:03.317890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 758/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:37:03.323848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245a3c5-5241-4fdd-a8c8-d47275f5d8b5 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:37:03.330333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245a3c5-5241-4fdd-a8c8-d47275f5d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:37:03.330333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245a3c5-5241-4fdd-a8c8-d47275f5d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:37:03.342796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f245a3c5-5241-4fdd-a8c8-d47275f5d8b5 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:37:03.343995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f245a3c5-5241-4fdd-a8c8-d47275f5d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:37:03.352558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 775/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:37:03.626144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcd1f9-3015-44ee-8b9b-4c9d0feef374 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:37:03.627830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-96fcd1f9-3015-44ee-8b9b-4c9d0feef374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:37:03.683861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcd1f9-3015-44ee-8b9b-4c9d0feef374 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:37:03.687632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d767f5-450a-4d22-b2a8-b593b9a72ffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:37:03.688281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d767f5-450a-4d22-b2a8-b593b9a72ffb service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:37:03.688569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d767f5-450a-4d22-b2a8-b593b9a72ffb service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:37:03.688852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d767f5-450a-4d22-b2a8-b593b9a72ffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:37:03.697539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d767f5-450a-4d22-b2a8-b593b9a72ffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:37:03.699014 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d767f5-450a-4d22-b2a8-b593b9a72ffb service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:37:03.708125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 759/1534] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:37:05.995059 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc918586-b8a6-404d-b616-ba6f1db12379 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:37:05.995587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc918586-b8a6-404d-b616-ba6f1db12379 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:37:05.995587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc918586-b8a6-404d-b616-ba6f1db12379 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:37:05.996915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 776/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu Apr 28 16:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:37:06.002074 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372efe-c017-4447-a212-6aee55332793 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:37:06.002520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372efe-c017-4447-a212-6aee55332793 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:37:06.002660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372efe-c017-4447-a212-6aee55332793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:37:06.020744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-fd372efe-c017-4447-a212-6aee55332793 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:37:06.021965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fd372efe-c017-4447-a212-6aee55332793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:37:06.029713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 760/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Apr 28 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:37:06.308888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919bd93-0a20-476f-8509-b6ea9876bd84 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:37:06.309177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919bd93-0a20-476f-8509-b6ea9876bd84 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:37:06.309457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919bd93-0a20-476f-8509-b6ea9876bd84 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:37:06.310862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 777/1537] 10.222.0.43 () {54 vars in 962 bytes} [Thu Apr 28 16:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:37:06.315791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd08c3-9305-49fc-af9c-16766d9d6d00 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:37:06.316090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd08c3-9305-49fc-af9c-16766d9d6d00 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:37:06.316376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd08c3-9305-49fc-af9c-16766d9d6d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:37:06.333879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6ffd08c3-9305-49fc-af9c-16766d9d6d00 None None] MFA Rules not processed for user `9a5c2cf875f8451890e04b97b9686956`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:37:06.337915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6ffd08c3-9305-49fc-af9c-16766d9d6d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:37:06.341616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 761/1538] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Apr 28 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:37:06.349126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919bd93-0a20-476f-8509-b6ea9876bd84 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:37:06.359895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919bd93-0a20-476f-8509-b6ea9876bd84 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:37:06.363382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883e4d9-c561-4e65-837c-392468e39203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:37:06.363982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e4d9-c561-4e65-837c-392468e39203 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:37:06.364264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e4d9-c561-4e65-837c-392468e39203 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:37:06.364539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e4d9-c561-4e65-837c-392468e39203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:37:06.373712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e4d9-c561-4e65-837c-392468e39203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:37:06.375179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883e4d9-c561-4e65-837c-392468e39203 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:37:06.384307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 778/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:39.159893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5c07d-2859-45dc-9fad-751c8bcd04ec None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.160541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5c07d-2859-45dc-9fad-751c8bcd04ec None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.160541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5c07d-2859-45dc-9fad-751c8bcd04ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.194824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-8db5c07d-2859-45dc-9fad-751c8bcd04ec None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.196551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8db5c07d-2859-45dc-9fad-751c8bcd04ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.212010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 762/1540] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.222221 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ff92-66bc-4042-93d4-cc6ab0ce090b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.222826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ff92-66bc-4042-93d4-cc6ab0ce090b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.222826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ff92-66bc-4042-93d4-cc6ab0ce090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.258411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-5032ff92-66bc-4042-93d4-cc6ab0ce090b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.259543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5032ff92-66bc-4042-93d4-cc6ab0ce090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.284969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 779/1541] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.292970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5c07d-2859-45dc-9fad-751c8bcd04ec None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:39.311640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5c07d-2859-45dc-9fad-751c8bcd04ec None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:39.326322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2fa94-5d24-495a-8343-463ee28a057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:39.327061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fa94-5d24-495a-8343-463ee28a057c admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.327358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fa94-5d24-495a-8343-463ee28a057c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.327647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fa94-5d24-495a-8343-463ee28a057c admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.328782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2fa94-5d24-495a-8343-463ee28a057c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:39.329104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2fa94-5d24-495a-8343-463ee28a057c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:39.331782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2fa94-5d24-495a-8343-463ee28a057c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:39.356728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 763/1542] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:39.364639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ff92-66bc-4042-93d4-cc6ab0ce090b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:39.377386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ff92-66bc-4042-93d4-cc6ab0ce090b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:39.395756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872f1b5-3def-47dc-bcde-e2a84077cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:39.395756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f1b5-3def-47dc-bcde-e2a84077cd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.395756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f1b5-3def-47dc-bcde-e2a84077cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.395756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872f1b5-3def-47dc-bcde-e2a84077cd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.396199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872f1b5-3def-47dc-bcde-e2a84077cd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:39.398024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872f1b5-3def-47dc-bcde-e2a84077cd40 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:39.436761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70151bf9-328c-47e5-bb2c-dfc699621408 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.437095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70151bf9-328c-47e5-bb2c-dfc699621408 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.437333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70151bf9-328c-47e5-bb2c-dfc699621408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.469583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-70151bf9-328c-47e5-bb2c-dfc699621408 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.471470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-70151bf9-328c-47e5-bb2c-dfc699621408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.489091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 764/1543] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:38:39.499594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708daf66-f013-4271-aea2-05798ad4057e None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.499968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708daf66-f013-4271-aea2-05798ad4057e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.500274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708daf66-f013-4271-aea2-05798ad4057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.513264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 780/1544] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:39.517151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872f1b5-3def-47dc-bcde-e2a84077cd40 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:39.530128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-708daf66-f013-4271-aea2-05798ad4057e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.531394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-708daf66-f013-4271-aea2-05798ad4057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.673715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 765/1545] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:38:39.675239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295f9c-e900-4909-8b2c-d9feb33793c4 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.675541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295f9c-e900-4909-8b2c-d9feb33793c4 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.675827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f295f9c-e900-4909-8b2c-d9feb33793c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.693890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872f1b5-3def-47dc-bcde-e2a84077cd40 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:39.699518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9f295f9c-e900-4909-8b2c-d9feb33793c4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.699874 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593fb4f-2307-45f0-90bd-b1f35f398e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:39.700902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593fb4f-2307-45f0-90bd-b1f35f398e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.700988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9f295f9c-e900-4909-8b2c-d9feb33793c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.701064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593fb4f-2307-45f0-90bd-b1f35f398e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.701321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593fb4f-2307-45f0-90bd-b1f35f398e35 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.702038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593fb4f-2307-45f0-90bd-b1f35f398e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:39.703422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING py.warnings [None req-1593fb4f-2307-45f0-90bd-b1f35f398e35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:38:39.703422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: warnings.warn(msg) Apr 28 16:38:39.703422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: Apr 28 16:38:39.704429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593fb4f-2307-45f0-90bd-b1f35f398e35 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:39.710344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 766/1546] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.719672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ff937-3d61-4d9e-a7a5-950567570801 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.720027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ff937-3d61-4d9e-a7a5-950567570801 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.720314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ff937-3d61-4d9e-a7a5-950567570801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.741002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f30ff937-3d61-4d9e-a7a5-950567570801 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.742496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f30ff937-3d61-4d9e-a7a5-950567570801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.751261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 767/1547] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.753818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84504-cce1-40c3-89d5-9f6d9f022e2e None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.754108 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84504-cce1-40c3-89d5-9f6d9f022e2e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.754386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84504-cce1-40c3-89d5-9f6d9f022e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.775807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-91d84504-cce1-40c3-89d5-9f6d9f022e2e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.777061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-91d84504-cce1-40c3-89d5-9f6d9f022e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.785311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 781/1548] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:38:39.793755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308da68-3a78-4c69-a56e-894e42600fc8 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.793755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308da68-3a78-4c69-a56e-894e42600fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.793755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308da68-3a78-4c69-a56e-894e42600fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.794029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 768/1549] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.794029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68416361-8663-4970-a89e-11b616b216e9 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.794029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68416361-8663-4970-a89e-11b616b216e9 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.794029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68416361-8663-4970-a89e-11b616b216e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.813431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-68416361-8663-4970-a89e-11b616b216e9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.815227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-68416361-8663-4970-a89e-11b616b216e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.815398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d308da68-3a78-4c69-a56e-894e42600fc8 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.816724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d308da68-3a78-4c69-a56e-894e42600fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.823148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 769/1550] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.823927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68416361-8663-4970-a89e-11b616b216e9 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:39.825010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 782/1551] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.833337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b75ab9-6c76-4e38-b95f-1f5679ded007 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.833337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b75ab9-6c76-4e38-b95f-1f5679ded007 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.833337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b75ab9-6c76-4e38-b95f-1f5679ded007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.834879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68416361-8663-4970-a89e-11b616b216e9 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:39.840221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3dff1f-e3c4-4b9e-84dc-7a6b4aad2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:39.840221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dff1f-e3c4-4b9e-84dc-7a6b4aad2fea admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.840452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dff1f-e3c4-4b9e-84dc-7a6b4aad2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.840693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dff1f-e3c4-4b9e-84dc-7a6b4aad2fea admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.841495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3dff1f-e3c4-4b9e-84dc-7a6b4aad2fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:39.841808 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3dff1f-e3c4-4b9e-84dc-7a6b4aad2fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:39.843431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3dff1f-e3c4-4b9e-84dc-7a6b4aad2fea admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:39.850477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-80b75ab9-6c76-4e38-b95f-1f5679ded007 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.851726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-80b75ab9-6c76-4e38-b95f-1f5679ded007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.862143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 770/1552] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:39.862143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349a05-0d63-4c2f-bb16-e11465265103 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.862143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349a05-0d63-4c2f-bb16-e11465265103 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.862143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349a05-0d63-4c2f-bb16-e11465265103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.862629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 783/1553] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.862629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b75ab9-6c76-4e38-b95f-1f5679ded007 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:39.871467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b75ab9-6c76-4e38-b95f-1f5679ded007 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:39.876264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082016-ea87-49c4-b780-39ccf4e87b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:39.876918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082016-ea87-49c4-b780-39ccf4e87b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.877722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082016-ea87-49c4-b780-39ccf4e87b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.878000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082016-ea87-49c4-b780-39ccf4e87b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.878509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-68349a05-0d63-4c2f-bb16-e11465265103 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.878762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0082016-ea87-49c4-b780-39ccf4e87b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:39.879783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-68349a05-0d63-4c2f-bb16-e11465265103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.880550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0082016-ea87-49c4-b780-39ccf4e87b6b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:39.891512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 771/1554] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.891512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aedf9-25d8-4a87-8143-3b61f9de9140 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.891512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aedf9-25d8-4a87-8143-3b61f9de9140 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.891512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aedf9-25d8-4a87-8143-3b61f9de9140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.891896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 784/1555] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:39.891896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1ceb-34c5-4fd4-b773-2d68ef2d8d84 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.892278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1ceb-34c5-4fd4-b773-2d68ef2d8d84 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.892471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1ceb-34c5-4fd4-b773-2d68ef2d8d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.908705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-531aedf9-25d8-4a87-8143-3b61f9de9140 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.909888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-531aedf9-25d8-4a87-8143-3b61f9de9140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.910423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-5a9c1ceb-34c5-4fd4-b773-2d68ef2d8d84 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.911637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5a9c1ceb-34c5-4fd4-b773-2d68ef2d8d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.918227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 772/1556] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.919290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68089-d515-4c1a-8921-08b5ae52f828 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.919427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 785/1557] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.923356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68089-d515-4c1a-8921-08b5ae52f828 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.923356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68089-d515-4c1a-8921-08b5ae52f828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.923555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388e19-e2b6-498d-b038-7bff6f39028d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.923555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388e19-e2b6-498d-b038-7bff6f39028d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.923555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb388e19-e2b6-498d-b038-7bff6f39028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.943817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-fb388e19-e2b6-498d-b038-7bff6f39028d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.943817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fb388e19-e2b6-498d-b038-7bff6f39028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.944121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-66e68089-d515-4c1a-8921-08b5ae52f828 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:39.944121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-66e68089-d515-4c1a-8921-08b5ae52f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:39.949544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 786/1558] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.950437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb388e19-e2b6-498d-b038-7bff6f39028d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:39.950779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 773/1559] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:39.954300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e68089-d515-4c1a-8921-08b5ae52f828 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:39.962497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e68089-d515-4c1a-8921-08b5ae52f828 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:39.962977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb388e19-e2b6-498d-b038-7bff6f39028d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:39.967489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:39.971336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406982ce-b52f-4525-beb9-8a4f907c478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:39.971466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.971578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406982ce-b52f-4525-beb9-8a4f907c478e admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:39.971675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.971771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406982ce-b52f-4525-beb9-8a4f907c478e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:39.971867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.971947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406982ce-b52f-4525-beb9-8a4f907c478e admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:39.972032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:39.972106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406982ce-b52f-4525-beb9-8a4f907c478e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:39.972182 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:39.972260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406982ce-b52f-4525-beb9-8a4f907c478e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:39.972332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:39.983186 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 774/1560] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:39.984064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:39.994028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6f8c2-d1c4-4dfb-8158-2d12294d72ab admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:39.998792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.001215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.001215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.001215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.001215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:40.001215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.003350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.015408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 775/1561] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:40.016181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.025915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7883a-3f63-46cf-8ce2-e0d802f1f1f2 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.030435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c9aa7-ec50-4998-b42a-d995c4d4d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.031191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9aa7-ec50-4998-b42a-d995c4d4d020 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.031476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9aa7-ec50-4998-b42a-d995c4d4d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.031751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9aa7-ec50-4998-b42a-d995c4d4d020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.032466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c9aa7-ec50-4998-b42a-d995c4d4d020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.034299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c9aa7-ec50-4998-b42a-d995c4d4d020 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.044953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 776/1562] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:40.045849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c9aa7-ec50-4998-b42a-d995c4d4d020 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.056841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c9aa7-ec50-4998-b42a-d995c4d4d020 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.060033 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 787/1563] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:39 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:40.061408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec090a9-cfcb-4c61-b957-4aee150da1ab None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.061734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec090a9-cfcb-4c61-b957-4aee150da1ab None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.062018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec090a9-cfcb-4c61-b957-4aee150da1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.065970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.066679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.066970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.067280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.068058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:40.068594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.070235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.080721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-cec090a9-cfcb-4c61-b957-4aee150da1ab None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:40.081914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cec090a9-cfcb-4c61-b957-4aee150da1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:40.082476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 777/1564] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:40.083301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.092636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01930dd8-eaab-4623-befb-4519e4dead36 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.139292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 788/1565] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:40.140134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec090a9-cfcb-4c61-b957-4aee150da1ab None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.149582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.149750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec090a9-cfcb-4c61-b957-4aee150da1ab None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.150387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.150708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.150998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.151738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:40.152052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.153666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.154378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.155053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.155350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.155623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.156339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:40.156641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.157649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING py.warnings [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:38:40.157649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: warnings.warn(msg) Apr 28 16:38:40.157649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: Apr 28 16:38:40.158854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.165760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 778/1566] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:40.166707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.176549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab7973-9860-4e55-aab4-3c62bbb7feaf admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.176716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 789/1567] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:40.177494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.185749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.186403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.186720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.186998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.187680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.188723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING py.warnings [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:38:40.188723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: warnings.warn(msg) Apr 28 16:38:40.188723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: Apr 28 16:38:40.190650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.192592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbaec1-09e3-488d-822c-886a87b64da0 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.197966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d39224-1da0-4324-9761-b8145a67baae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.198710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d39224-1da0-4324-9761-b8145a67baae admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.199125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d39224-1da0-4324-9761-b8145a67baae admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.199450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d39224-1da0-4324-9761-b8145a67baae admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.200322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d39224-1da0-4324-9761-b8145a67baae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.202470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d39224-1da0-4324-9761-b8145a67baae admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.317611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 779/1568] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:40.318429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.351228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 790/1569] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:40.352118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d39224-1da0-4324-9761-b8145a67baae admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.378660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde8950-5259-43fe-912e-a9989fcc04e7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.412648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d39224-1da0-4324-9761-b8145a67baae admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.417228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942bde3-cf3d-48a7-81db-fe744b871512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.417891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942bde3-cf3d-48a7-81db-fe744b871512 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.418180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942bde3-cf3d-48a7-81db-fe744b871512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.418455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942bde3-cf3d-48a7-81db-fe744b871512 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.419171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942bde3-cf3d-48a7-81db-fe744b871512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.421112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942bde3-cf3d-48a7-81db-fe744b871512 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.432159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.433055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.433341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.433620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] PATH_INFO: `/v3/projects/c1a16f50ada34caf8ebc452c5c6c7e41/users/2bd92566dbce48b29f16e818cae257c4/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.447412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a16f50ada34caf8ebc452c5c6c7e41, user_id=2bd92566dbce48b29f16e818cae257c4, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.457631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING py.warnings [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:38:40.457631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: warnings.warn(msg) Apr 28 16:38:40.457631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: Apr 28 16:38:40.457631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.539077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 791/1570] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:40.540639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942bde3-cf3d-48a7-81db-fe744b871512 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.550525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 780/1571] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:40 2022] PUT /identity/v3/projects/c1a16f50ada34caf8ebc452c5c6c7e41/users/2bd92566dbce48b29f16e818cae257c4/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:40.551160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942bde3-cf3d-48a7-81db-fe744b871512 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.556822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.607624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7290-cc4f-4711-95ba-dd4b9ee7e16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.608286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7290-cc4f-4711-95ba-dd4b9ee7e16b admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.608572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7290-cc4f-4711-95ba-dd4b9ee7e16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.608851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7290-cc4f-4711-95ba-dd4b9ee7e16b admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.609538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a7290-cc4f-4711-95ba-dd4b9ee7e16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.612116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a7290-cc4f-4711-95ba-dd4b9ee7e16b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.615404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3396310-8baf-4fed-8d12-ac0a5d64c23f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.620156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.620856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.621147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.621434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.622168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:40.622486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.624137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.635495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 781/1572] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:40.636340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.645920 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca542db-5679-4e20-bc62-9858efd52c42 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.650492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2de5b-8996-4cd5-bcda-d6beb3243f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.651142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2de5b-8996-4cd5-bcda-d6beb3243f74 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.651429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2de5b-8996-4cd5-bcda-d6beb3243f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.651709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2de5b-8996-4cd5-bcda-d6beb3243f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.652396 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2de5b-8996-4cd5-bcda-d6beb3243f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.654311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2de5b-8996-4cd5-bcda-d6beb3243f74 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.723021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 792/1573] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/projects => generated 391 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:40.723898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7290-cc4f-4711-95ba-dd4b9ee7e16b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.750840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 782/1574] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:40.752785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2de5b-8996-4cd5-bcda-d6beb3243f74 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.784409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7290-cc4f-4711-95ba-dd4b9ee7e16b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.815644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2de5b-8996-4cd5-bcda-d6beb3243f74 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.820367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461a0b-492b-4397-a1c1-e023b990339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.821040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461a0b-492b-4397-a1c1-e023b990339b admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.821329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461a0b-492b-4397-a1c1-e023b990339b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.821612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461a0b-492b-4397-a1c1-e023b990339b admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.822303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45461a0b-492b-4397-a1c1-e023b990339b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.824280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45461a0b-492b-4397-a1c1-e023b990339b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.837349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe917-4388-4875-a7d7-ba8d2a6cfc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:40.838008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe917-4388-4875-a7d7-ba8d2a6cfc2c admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:40.838293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe917-4388-4875-a7d7-ba8d2a6cfc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:40.838600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fe917-4388-4875-a7d7-ba8d2a6cfc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:40.839290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fe917-4388-4875-a7d7-ba8d2a6cfc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:40.841184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fe917-4388-4875-a7d7-ba8d2a6cfc2c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:40.932960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 783/1575] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:40.933773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461a0b-492b-4397-a1c1-e023b990339b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:40.943497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461a0b-492b-4397-a1c1-e023b990339b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:40.945639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 793/1576] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:40.946624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe917-4388-4875-a7d7-ba8d2a6cfc2c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.001244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9fd6e-4a33-4887-a0bc-332e8e37c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.001841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9fd6e-4a33-4887-a0bc-332e8e37c9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.002163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9fd6e-4a33-4887-a0bc-332e8e37c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.002442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9fd6e-4a33-4887-a0bc-332e8e37c9bf admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.003227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9fd6e-4a33-4887-a0bc-332e8e37c9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.005220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9fd6e-4a33-4887-a0bc-332e8e37c9bf admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.008517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fe917-4388-4875-a7d7-ba8d2a6cfc2c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.013238 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf75e-24e2-46bf-88f3-9c22a9c71a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.013898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf75e-24e2-46bf-88f3-9c22a9c71a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.014183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf75e-24e2-46bf-88f3-9c22a9c71a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.014457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf75e-24e2-46bf-88f3-9c22a9c71a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.015517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cf75e-24e2-46bf-88f3-9c22a9c71a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.017149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cf75e-24e2-46bf-88f3-9c22a9c71a64 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.027778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 794/1577] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.029012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59029b7-1b70-4bfd-a990-47c57dc1f338 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.029300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59029b7-1b70-4bfd-a990-47c57dc1f338 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.029578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59029b7-1b70-4bfd-a990-47c57dc1f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.056050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d59029b7-1b70-4bfd-a990-47c57dc1f338 None None] MFA Rules not processed for user `2bd92566dbce48b29f16e818cae257c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:41.057283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d59029b7-1b70-4bfd-a990-47c57dc1f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:41.099634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 784/1578] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:40 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:41.100522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9fd6e-4a33-4887-a0bc-332e8e37c9bf admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.110430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9fd6e-4a33-4887-a0bc-332e8e37c9bf admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.115018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cf074-3fe4-4541-ab01-71393092a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.115660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cf074-3fe4-4541-ab01-71393092a64e admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.115952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cf074-3fe4-4541-ab01-71393092a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.116234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524cf074-3fe4-4541-ab01-71393092a64e admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.116926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cf074-3fe4-4541-ab01-71393092a64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.118905 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524cf074-3fe4-4541-ab01-71393092a64e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.120917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 795/1579] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:41.121732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59029b7-1b70-4bfd-a990-47c57dc1f338 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.132156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59029b7-1b70-4bfd-a990-47c57dc1f338 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.136771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbb586-5934-4d22-b242-0c0a7e57ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.142472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbb586-5934-4d22-b242-0c0a7e57ebb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.142472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbb586-5934-4d22-b242-0c0a7e57ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.142472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbb586-5934-4d22-b242-0c0a7e57ebb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.142472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbb586-5934-4d22-b242-0c0a7e57ebb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.142472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbb586-5934-4d22-b242-0c0a7e57ebb8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.197840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 785/1580] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:41 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:41.198677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cf074-3fe4-4541-ab01-71393092a64e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.224600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 796/1581] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:41 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:41.225322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbb586-5934-4d22-b242-0c0a7e57ebb8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.236397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbb586-5934-4d22-b242-0c0a7e57ebb8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.258721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524cf074-3fe4-4541-ab01-71393092a64e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.263246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7a22-934a-4182-bfbf-7b2a271f0270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.263898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7a22-934a-4182-bfbf-7b2a271f0270 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.264183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7a22-934a-4182-bfbf-7b2a271f0270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.264465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7a22-934a-4182-bfbf-7b2a271f0270 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.265163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7a22-934a-4182-bfbf-7b2a271f0270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.267232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7a22-934a-4182-bfbf-7b2a271f0270 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.293108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c18c3-33ba-43c8-a470-87f7ed59286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.293776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c18c3-33ba-43c8-a470-87f7ed59286c admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.294060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c18c3-33ba-43c8-a470-87f7ed59286c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.294334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c18c3-33ba-43c8-a470-87f7ed59286c admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.295101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c18c3-33ba-43c8-a470-87f7ed59286c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.296785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c18c3-33ba-43c8-a470-87f7ed59286c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.306291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 797/1582] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.307086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c18c3-33ba-43c8-a470-87f7ed59286c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.316649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c18c3-33ba-43c8-a470-87f7ed59286c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.321462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbf7db-c8e7-4911-84e0-c0c6664fcfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.322118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbf7db-c8e7-4911-84e0-c0c6664fcfba admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.322402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbf7db-c8e7-4911-84e0-c0c6664fcfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.322715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbf7db-c8e7-4911-84e0-c0c6664fcfba admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.323418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbf7db-c8e7-4911-84e0-c0c6664fcfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.325469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbf7db-c8e7-4911-84e0-c0c6664fcfba admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.339346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 786/1583] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:41 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:41.341614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7a22-934a-4182-bfbf-7b2a271f0270 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.349739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7a22-934a-4182-bfbf-7b2a271f0270 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.354321 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa7a75-4075-4a5d-b0a1-2594780f3eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.355000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7a75-4075-4a5d-b0a1-2594780f3eff admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.355282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7a75-4075-4a5d-b0a1-2594780f3eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.355561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7a75-4075-4a5d-b0a1-2594780f3eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.356282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa7a75-4075-4a5d-b0a1-2594780f3eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.357859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa7a75-4075-4a5d-b0a1-2594780f3eff admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.367415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 787/1584] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.370419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa7a75-4075-4a5d-b0a1-2594780f3eff admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.377956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa7a75-4075-4a5d-b0a1-2594780f3eff admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.382514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16216cd-b953-41dc-a570-5fb8fe1ca130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.383207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16216cd-b953-41dc-a570-5fb8fe1ca130 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.383502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16216cd-b953-41dc-a570-5fb8fe1ca130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.383789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16216cd-b953-41dc-a570-5fb8fe1ca130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.384533 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16216cd-b953-41dc-a570-5fb8fe1ca130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.386097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16216cd-b953-41dc-a570-5fb8fe1ca130 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.396921 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 788/1585] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.397664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16216cd-b953-41dc-a570-5fb8fe1ca130 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.406714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16216cd-b953-41dc-a570-5fb8fe1ca130 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.411506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d50dc-d1a2-47f0-9e72-c4727633e52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.412101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d50dc-d1a2-47f0-9e72-c4727633e52e admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.412392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d50dc-d1a2-47f0-9e72-c4727633e52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.412671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d50dc-d1a2-47f0-9e72-c4727633e52e admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.413338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d50dc-d1a2-47f0-9e72-c4727633e52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.415200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d50dc-d1a2-47f0-9e72-c4727633e52e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.424596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 798/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:41 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:41.425278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbf7db-c8e7-4911-84e0-c0c6664fcfba admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.434581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbf7db-c8e7-4911-84e0-c0c6664fcfba admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.439403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08096933-de6a-4c57-95df-06fbf86bdf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.442284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096933-de6a-4c57-95df-06fbf86bdf21 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.442591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096933-de6a-4c57-95df-06fbf86bdf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.442869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096933-de6a-4c57-95df-06fbf86bdf21 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.443560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08096933-de6a-4c57-95df-06fbf86bdf21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.445494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08096933-de6a-4c57-95df-06fbf86bdf21 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.528572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 789/1587] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:41 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:41.529332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d50dc-d1a2-47f0-9e72-c4727633e52e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.556846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 799/1588] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:41 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:41.560657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08096933-de6a-4c57-95df-06fbf86bdf21 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.568294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08096933-de6a-4c57-95df-06fbf86bdf21 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.591161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d50dc-d1a2-47f0-9e72-c4727633e52e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.595805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e91f2-56c6-4f8e-806b-d1adab946af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.596479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e91f2-56c6-4f8e-806b-d1adab946af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.596765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e91f2-56c6-4f8e-806b-d1adab946af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.597052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e91f2-56c6-4f8e-806b-d1adab946af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.597787 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e91f2-56c6-4f8e-806b-d1adab946af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.599439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e91f2-56c6-4f8e-806b-d1adab946af3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.608880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 790/1589] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.609665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e91f2-56c6-4f8e-806b-d1adab946af3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.619410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e91f2-56c6-4f8e-806b-d1adab946af3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.622374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5ed6-a37c-458a-9cad-6ac064c4291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.623077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5ed6-a37c-458a-9cad-6ac064c4291a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.623365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5ed6-a37c-458a-9cad-6ac064c4291a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.623643 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b5ed6-a37c-458a-9cad-6ac064c4291a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.624262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9852-927b-452b-b916-36c865aa1ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.624390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b5ed6-a37c-458a-9cad-6ac064c4291a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.624898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9852-927b-452b-b916-36c865aa1ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.625181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9852-927b-452b-b916-36c865aa1ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.625455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c9852-927b-452b-b916-36c865aa1ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.625963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b5ed6-a37c-458a-9cad-6ac064c4291a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.626173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c9852-927b-452b-b916-36c865aa1ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.628382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c9852-927b-452b-b916-36c865aa1ae9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.636256 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 800/1590] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.637167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5ed6-a37c-458a-9cad-6ac064c4291a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.639738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 791/1591] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.640497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9852-927b-452b-b916-36c865aa1ae9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.647302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b5ed6-a37c-458a-9cad-6ac064c4291a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.650948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c9852-927b-452b-b916-36c865aa1ae9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.651883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7335b-cc93-46d4-89d9-2853435df461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.652756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7335b-cc93-46d4-89d9-2853435df461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.653075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7335b-cc93-46d4-89d9-2853435df461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.653352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7335b-cc93-46d4-89d9-2853435df461 admin admin] PATH_INFO: `/v3/projects/365a8e17d27f40e1a3c9cf4864bc0c8a/users/0557cb45047b49818d049d5b1bb7f49f/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.655869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc56d67-61c9-4ddb-8622-a7f165e3eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.656513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc56d67-61c9-4ddb-8622-a7f165e3eda4 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.656796 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc56d67-61c9-4ddb-8622-a7f165e3eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.657069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc56d67-61c9-4ddb-8622-a7f165e3eda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.657788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc56d67-61c9-4ddb-8622-a7f165e3eda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.659723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc56d67-61c9-4ddb-8622-a7f165e3eda4 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.667942 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7335b-cc93-46d4-89d9-2853435df461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365a8e17d27f40e1a3c9cf4864bc0c8a, user_id=0557cb45047b49818d049d5b1bb7f49f, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.671123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 792/1592] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.671289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7335b-cc93-46d4-89d9-2853435df461 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.671371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc56d67-61c9-4ddb-8622-a7f165e3eda4 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.683487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc56d67-61c9-4ddb-8622-a7f165e3eda4 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.688140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7895ca-0d40-403f-9cfc-f70d7af66059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.688809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7895ca-0d40-403f-9cfc-f70d7af66059 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.689096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7895ca-0d40-403f-9cfc-f70d7af66059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.689372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7895ca-0d40-403f-9cfc-f70d7af66059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.690973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7895ca-0d40-403f-9cfc-f70d7af66059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.692385 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7895ca-0d40-403f-9cfc-f70d7af66059 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.703284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 793/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.707510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7895ca-0d40-403f-9cfc-f70d7af66059 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.717734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7895ca-0d40-403f-9cfc-f70d7af66059 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.722524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc006-5bf1-4948-9a69-d16f5cfe612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.729015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc006-5bf1-4948-9a69-d16f5cfe612f admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.729015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc006-5bf1-4948-9a69-d16f5cfe612f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.729015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbc006-5bf1-4948-9a69-d16f5cfe612f admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.729015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc006-5bf1-4948-9a69-d16f5cfe612f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.729015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbc006-5bf1-4948-9a69-d16f5cfe612f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.744646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 801/1594] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:41 2022] PUT /identity/v3/projects/365a8e17d27f40e1a3c9cf4864bc0c8a/users/0557cb45047b49818d049d5b1bb7f49f/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:41.749433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7335b-cc93-46d4-89d9-2853435df461 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.791488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 794/1595] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:41 2022] POST /identity/v3/users => generated 292 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:41.792629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc006-5bf1-4948-9a69-d16f5cfe612f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.804028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbc006-5bf1-4948-9a69-d16f5cfe612f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.816331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7335b-cc93-46d4-89d9-2853435df461 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.821404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec95cb-9af1-43fd-8935-f8c2c19bc4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.822273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec95cb-9af1-43fd-8935-f8c2c19bc4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.822593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec95cb-9af1-43fd-8935-f8c2c19bc4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.822877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec95cb-9af1-43fd-8935-f8c2c19bc4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.823611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec95cb-9af1-43fd-8935-f8c2c19bc4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.825257 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec95cb-9af1-43fd-8935-f8c2c19bc4cd admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.835321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 802/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.836106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec95cb-9af1-43fd-8935-f8c2c19bc4cd admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.845491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec95cb-9af1-43fd-8935-f8c2c19bc4cd admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.851330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aee70-5981-4850-b1a1-93c51c0dfd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.852211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aee70-5981-4850-b1a1-93c51c0dfd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.852484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aee70-5981-4850-b1a1-93c51c0dfd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.852765 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aee70-5981-4850-b1a1-93c51c0dfd24 admin admin] PATH_INFO: `/v3/projects/c2364720daae4bf48b5408c3047da3b9/users/a3de084ad4bc44239b89fab61a60dcb9/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.860224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b23d3e-a116-45c7-83a3-6d2061f35850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.861036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b23d3e-a116-45c7-83a3-6d2061f35850 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.861480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b23d3e-a116-45c7-83a3-6d2061f35850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.862315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b23d3e-a116-45c7-83a3-6d2061f35850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.863171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b23d3e-a116-45c7-83a3-6d2061f35850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.864896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b23d3e-a116-45c7-83a3-6d2061f35850 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.870450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aee70-5981-4850-b1a1-93c51c0dfd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2364720daae4bf48b5408c3047da3b9, user_id=a3de084ad4bc44239b89fab61a60dcb9, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.873370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aee70-5981-4850-b1a1-93c51c0dfd24 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.875365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 795/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.876124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b23d3e-a116-45c7-83a3-6d2061f35850 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.886290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b23d3e-a116-45c7-83a3-6d2061f35850 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.891294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a655c2a-9cee-4afc-af0e-d43b9afc8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.891973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a655c2a-9cee-4afc-af0e-d43b9afc8adc admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.892260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a655c2a-9cee-4afc-af0e-d43b9afc8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.892539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a655c2a-9cee-4afc-af0e-d43b9afc8adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.893312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a655c2a-9cee-4afc-af0e-d43b9afc8adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.894948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a655c2a-9cee-4afc-af0e-d43b9afc8adc admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:41.908030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 796/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:41.909697 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a655c2a-9cee-4afc-af0e-d43b9afc8adc admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.921512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a655c2a-9cee-4afc-af0e-d43b9afc8adc admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:41.931743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1241017-4c37-42b0-9490-4532fb55243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:41.932660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241017-4c37-42b0-9490-4532fb55243b admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:41.932945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241017-4c37-42b0-9490-4532fb55243b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:41.933223 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1241017-4c37-42b0-9490-4532fb55243b admin admin] PATH_INFO: `/v3/projects/6a21a2af9f474ecca0a8c21f2ded2e03/users/e04c5ab5dd08474d860712151943f04b/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:41.933842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 803/1599] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:41 2022] PUT /identity/v3/projects/c2364720daae4bf48b5408c3047da3b9/users/a3de084ad4bc44239b89fab61a60dcb9/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:41.935025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aee70-5981-4850-b1a1-93c51c0dfd24 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:41.952485 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1241017-4c37-42b0-9490-4532fb55243b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a21a2af9f474ecca0a8c21f2ded2e03, user_id=e04c5ab5dd08474d860712151943f04b, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:41.955468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1241017-4c37-42b0-9490-4532fb55243b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.003814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aee70-5981-4850-b1a1-93c51c0dfd24 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.009197 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1263a-3c66-4b0c-b31b-94219fa8e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.009872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1263a-3c66-4b0c-b31b-94219fa8e7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.010161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1263a-3c66-4b0c-b31b-94219fa8e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.010448 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1263a-3c66-4b0c-b31b-94219fa8e7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.011256 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1263a-3c66-4b0c-b31b-94219fa8e7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.012895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1263a-3c66-4b0c-b31b-94219fa8e7c8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.013803 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 797/1600] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:41 2022] PUT /identity/v3/projects/6a21a2af9f474ecca0a8c21f2ded2e03/users/e04c5ab5dd08474d860712151943f04b/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:42.015158 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdc97-dacb-4702-ad92-7982c3f04206 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.015443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdc97-dacb-4702-ad92-7982c3f04206 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.015731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdc97-dacb-4702-ad92-7982c3f04206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.023385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 804/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:42.024218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1263a-3c66-4b0c-b31b-94219fa8e7c8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.034373 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1263a-3c66-4b0c-b31b-94219fa8e7c8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.043288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-45cfdc97-dacb-4702-ad92-7982c3f04206 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:42.044618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-45cfdc97-dacb-4702-ad92-7982c3f04206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:42.106975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 798/1602] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:42.107874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfdc97-dacb-4702-ad92-7982c3f04206 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.118325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfdc97-dacb-4702-ad92-7982c3f04206 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.123175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbc7e1-0dd1-44e0-8f41-f10b967e8dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.123874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc7e1-0dd1-44e0-8f41-f10b967e8dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.124159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc7e1-0dd1-44e0-8f41-f10b967e8dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.124437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbc7e1-0dd1-44e0-8f41-f10b967e8dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.125202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbc7e1-0dd1-44e0-8f41-f10b967e8dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.126962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbc7e1-0dd1-44e0-8f41-f10b967e8dc6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.137604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 799/1603] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:42.138457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbc7e1-0dd1-44e0-8f41-f10b967e8dc6 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.148563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbc7e1-0dd1-44e0-8f41-f10b967e8dc6 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.153315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9a302-9a90-493a-8ccb-8763014e281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.154221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9a302-9a90-493a-8ccb-8763014e281f admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.154501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9a302-9a90-493a-8ccb-8763014e281f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.154855 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9a302-9a90-493a-8ccb-8763014e281f admin admin] PATH_INFO: `/v3/projects/0cda26128b0441359a1a609c68e2497c/users/788335ddb63f4b458dd3e5b38ea3a79a/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.170957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9a302-9a90-493a-8ccb-8763014e281f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cda26128b0441359a1a609c68e2497c, user_id=788335ddb63f4b458dd3e5b38ea3a79a, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.173610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9a302-9a90-493a-8ccb-8763014e281f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.218832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a037e-8e81-405e-a23e-16df0c1990ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.219222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 800/1604] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:42 2022] PUT /identity/v3/projects/0cda26128b0441359a1a609c68e2497c/users/788335ddb63f4b458dd3e5b38ea3a79a/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:42.223868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a037e-8e81-405e-a23e-16df0c1990ec admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.223868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a037e-8e81-405e-a23e-16df0c1990ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.224048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9a302-9a90-493a-8ccb-8763014e281f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.224156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a037e-8e81-405e-a23e-16df0c1990ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.224156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a037e-8e81-405e-a23e-16df0c1990ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.224156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a037e-8e81-405e-a23e-16df0c1990ec admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.237813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 805/1605] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:42.237813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d683f-304d-408d-9c5b-0ba3e30bca6b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.237813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d683f-304d-408d-9c5b-0ba3e30bca6b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.237813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d683f-304d-408d-9c5b-0ba3e30bca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.254967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-dc6d683f-304d-408d-9c5b-0ba3e30bca6b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:42.257010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-dc6d683f-304d-408d-9c5b-0ba3e30bca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:42.297724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9a302-9a90-493a-8ccb-8763014e281f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.302957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59e213-4f38-4c13-aa7b-d2820496a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.303858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e213-4f38-4c13-aa7b-d2820496a2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.304163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e213-4f38-4c13-aa7b-d2820496a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.304512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e213-4f38-4c13-aa7b-d2820496a2d1 admin admin] PATH_INFO: `/v3/projects/ff3914a15ff3432baec432bf7f677b55/users/d117fee119c3498d81ea2f6c29f6bad6/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.319107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59e213-4f38-4c13-aa7b-d2820496a2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3914a15ff3432baec432bf7f677b55, user_id=d117fee119c3498d81ea2f6c29f6bad6, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.321785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59e213-4f38-4c13-aa7b-d2820496a2d1 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.323903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 806/1606] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:42.325289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822fdcd-38b3-4a6f-8d3a-6286320bbe67 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.325625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822fdcd-38b3-4a6f-8d3a-6286320bbe67 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.325904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822fdcd-38b3-4a6f-8d3a-6286320bbe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.352769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d822fdcd-38b3-4a6f-8d3a-6286320bbe67 None None] MFA Rules not processed for user `e04c5ab5dd08474d860712151943f04b`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:42.353985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d822fdcd-38b3-4a6f-8d3a-6286320bbe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:42.385359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 801/1607] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:42 2022] PUT /identity/v3/projects/ff3914a15ff3432baec432bf7f677b55/users/d117fee119c3498d81ea2f6c29f6bad6/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:42.386181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59e213-4f38-4c13-aa7b-d2820496a2d1 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.417065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 807/1608] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:42.417903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822fdcd-38b3-4a6f-8d3a-6286320bbe67 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.454105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59e213-4f38-4c13-aa7b-d2820496a2d1 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.459740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5154b-8fed-4378-bf03-0eebed767006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.460818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5154b-8fed-4378-bf03-0eebed767006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.461112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5154b-8fed-4378-bf03-0eebed767006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.461399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5154b-8fed-4378-bf03-0eebed767006 admin admin] PATH_INFO: `/v3/projects/7a465fa86d1140f0adfc06a6827bcb36/users/01865938642340cf82f67e4f52be16e0/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.469296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822fdcd-38b3-4a6f-8d3a-6286320bbe67 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.476148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5154b-8fed-4378-bf03-0eebed767006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a465fa86d1140f0adfc06a6827bcb36, user_id=01865938642340cf82f67e4f52be16e0, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.478866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5154b-8fed-4378-bf03-0eebed767006 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.515709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a9d9-bfc8-44d3-b5f5-d4b85b811da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.516359 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a9d9-bfc8-44d3-b5f5-d4b85b811da5 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.516639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a9d9-bfc8-44d3-b5f5-d4b85b811da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.516910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a9d9-bfc8-44d3-b5f5-d4b85b811da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.526208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962a9d9-bfc8-44d3-b5f5-d4b85b811da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.527691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962a9d9-bfc8-44d3-b5f5-d4b85b811da5 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.537720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 808/1609] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:42.538461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a9d9-bfc8-44d3-b5f5-d4b85b811da5 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.547157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a9d9-bfc8-44d3-b5f5-d4b85b811da5 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.552007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b033d-01cd-41f8-9a91-0b849dd6e33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.552882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b033d-01cd-41f8-9a91-0b849dd6e33c admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.553437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b033d-01cd-41f8-9a91-0b849dd6e33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.553581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b033d-01cd-41f8-9a91-0b849dd6e33c admin admin] PATH_INFO: `/v3/projects/42da459950064ee2bed6cba97ed9986d/users/945ab009e1024a199a324e9c4941e8fe/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.566607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 802/1610] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:42 2022] PUT /identity/v3/projects/7a465fa86d1140f0adfc06a6827bcb36/users/01865938642340cf82f67e4f52be16e0/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:42.566607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b6680-d60d-4d59-a306-1617a4ec95e6 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.566607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b6680-d60d-4d59-a306-1617a4ec95e6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.566607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b6680-d60d-4d59-a306-1617a4ec95e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.570009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b033d-01cd-41f8-9a91-0b849dd6e33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42da459950064ee2bed6cba97ed9986d, user_id=945ab009e1024a199a324e9c4941e8fe, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.572828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b033d-01cd-41f8-9a91-0b849dd6e33c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.583194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-546b6680-d60d-4d59-a306-1617a4ec95e6 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:42.584397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-546b6680-d60d-4d59-a306-1617a4ec95e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:42.645466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 803/1611] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:42.645466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b6680-d60d-4d59-a306-1617a4ec95e6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.652408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b6680-d60d-4d59-a306-1617a4ec95e6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.657132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc15295-0414-4d3d-bb7b-4ee35e714ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.657999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc15295-0414-4d3d-bb7b-4ee35e714ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.658588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc15295-0414-4d3d-bb7b-4ee35e714ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.658873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc15295-0414-4d3d-bb7b-4ee35e714ba2 admin admin] PATH_INFO: `/v3/projects/dddc1bfd80f44537a74043d2752e33c8/users/5b38c7211ed94a28a3b6c8fd17cec263/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.673055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc15295-0414-4d3d-bb7b-4ee35e714ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dddc1bfd80f44537a74043d2752e33c8, user_id=5b38c7211ed94a28a3b6c8fd17cec263, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.675896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc15295-0414-4d3d-bb7b-4ee35e714ba2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.693834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 809/1612] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:42 2022] PUT /identity/v3/projects/42da459950064ee2bed6cba97ed9986d/users/945ab009e1024a199a324e9c4941e8fe/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:42.697557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b033d-01cd-41f8-9a91-0b849dd6e33c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.748985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b033d-01cd-41f8-9a91-0b849dd6e33c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.751388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 804/1613] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:42 2022] PUT /identity/v3/projects/dddc1bfd80f44537a74043d2752e33c8/users/5b38c7211ed94a28a3b6c8fd17cec263/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:42.753140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be590-8da6-4083-ab18-c4fc6d252b4e None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.753434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be590-8da6-4083-ab18-c4fc6d252b4e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.753742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be590-8da6-4083-ab18-c4fc6d252b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.780387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-775be590-8da6-4083-ab18-c4fc6d252b4e None None] MFA Rules not processed for user `d117fee119c3498d81ea2f6c29f6bad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:42.781633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-775be590-8da6-4083-ab18-c4fc6d252b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:42.797990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5f9d2-ded1-4370-a7cd-a9cf4ba13466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.798696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f9d2-ded1-4370-a7cd-a9cf4ba13466 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.799213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f9d2-ded1-4370-a7cd-a9cf4ba13466 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.799496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5f9d2-ded1-4370-a7cd-a9cf4ba13466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.851860 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 805/1614] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:42.853592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d452c7-9fb3-431f-91f9-f79922adac1e None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.853810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d452c7-9fb3-431f-91f9-f79922adac1e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.854081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d452c7-9fb3-431f-91f9-f79922adac1e None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.855673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 806/1615] 10.222.0.43 () {54 vars in 960 bytes} [Thu Apr 28 16:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:38:42.857177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b244b-ca05-4163-b82f-b517763f783d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.857375 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b244b-ca05-4163-b82f-b517763f783d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.857654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b244b-ca05-4163-b82f-b517763f783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.871927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5f9d2-ded1-4370-a7cd-a9cf4ba13466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.871927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5f9d2-ded1-4370-a7cd-a9cf4ba13466 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.889018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 810/1616] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:42.889481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9a4b244b-ca05-4163-b82f-b517763f783d None None] MFA Rules not processed for user `01865938642340cf82f67e4f52be16e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:42.890100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5f9d2-ded1-4370-a7cd-a9cf4ba13466 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.891095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9a4b244b-ca05-4163-b82f-b517763f783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:42.900287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5f9d2-ded1-4370-a7cd-a9cf4ba13466 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.904227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86ddad-4e6e-4b87-81e7-7227c7ecab82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.904871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86ddad-4e6e-4b87-81e7-7227c7ecab82 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.905154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86ddad-4e6e-4b87-81e7-7227c7ecab82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.905431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86ddad-4e6e-4b87-81e7-7227c7ecab82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.917035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86ddad-4e6e-4b87-81e7-7227c7ecab82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.918569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86ddad-4e6e-4b87-81e7-7227c7ecab82 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.929484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 811/1617] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:42.931100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cdf67-daa8-4f36-8caf-5187b6202857 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.931392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cdf67-daa8-4f36-8caf-5187b6202857 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.931690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cdf67-daa8-4f36-8caf-5187b6202857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.951639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e33cdf67-daa8-4f36-8caf-5187b6202857 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:42.952912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e33cdf67-daa8-4f36-8caf-5187b6202857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:42.965190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 807/1618] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:42.965190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b244b-ca05-4163-b82f-b517763f783d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.965439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 812/1619] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:42.965439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cdf67-daa8-4f36-8caf-5187b6202857 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:42.977411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b244b-ca05-4163-b82f-b517763f783d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.981051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cdf67-daa8-4f36-8caf-5187b6202857 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:42.982894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d5b17-4344-42c2-bf66-b2998ee1bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.983566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d5b17-4344-42c2-bf66-b2998ee1bc1a admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.989195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d5b17-4344-42c2-bf66-b2998ee1bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.989195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d5b17-4344-42c2-bf66-b2998ee1bc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.989195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d5b17-4344-42c2-bf66-b2998ee1bc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.989484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32d7f-b099-430e-b4b1-f01ee1bba870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:42.989600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d5b17-4344-42c2-bf66-b2998ee1bc1a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.989698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32d7f-b099-430e-b4b1-f01ee1bba870 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.989698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32d7f-b099-430e-b4b1-f01ee1bba870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.989698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc32d7f-b099-430e-b4b1-f01ee1bba870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:42.989698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32d7f-b099-430e-b4b1-f01ee1bba870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:42.990669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc32d7f-b099-430e-b4b1-f01ee1bba870 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:42.997878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 808/1620] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:42.999144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490210c-0479-4145-860c-94a0bbb255f6 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:42.999436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490210c-0479-4145-860c-94a0bbb255f6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:42.999713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490210c-0479-4145-860c-94a0bbb255f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.017906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5490210c-0479-4145-860c-94a0bbb255f6 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:43.019132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5490210c-0479-4145-860c-94a0bbb255f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:43.089643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 809/1621] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:43.090431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490210c-0479-4145-860c-94a0bbb255f6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.102778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490210c-0479-4145-860c-94a0bbb255f6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:43.105803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 813/1622] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:42 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:43.106657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32d7f-b099-430e-b4b1-f01ee1bba870 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.110081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702478e-fd54-45f1-8272-caf2b7e216e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:43.112041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702478e-fd54-45f1-8272-caf2b7e216e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.112041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702478e-fd54-45f1-8272-caf2b7e216e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.112041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702478e-fd54-45f1-8272-caf2b7e216e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.122708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702478e-fd54-45f1-8272-caf2b7e216e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:43.126000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702478e-fd54-45f1-8272-caf2b7e216e4 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:43.137047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 810/1623] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:43.138274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702478e-fd54-45f1-8272-caf2b7e216e4 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.154282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702478e-fd54-45f1-8272-caf2b7e216e4 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:43.169185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc32d7f-b099-430e-b4b1-f01ee1bba870 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:43.172885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414147c-6871-411e-92f8-04ad47a64dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:43.173544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414147c-6871-411e-92f8-04ad47a64dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.174463 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414147c-6871-411e-92f8-04ad47a64dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.174792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414147c-6871-411e-92f8-04ad47a64dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.230530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0621ef-d33c-4269-a812-8aa945895316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:43.231495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0621ef-d33c-4269-a812-8aa945895316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.231771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0621ef-d33c-4269-a812-8aa945895316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.232052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0621ef-d33c-4269-a812-8aa945895316 admin admin] PATH_INFO: `/v3/projects/dddc1bfd80f44537a74043d2752e33c8/users/5b38c7211ed94a28a3b6c8fd17cec263/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.234242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0621ef-d33c-4269-a812-8aa945895316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dddc1bfd80f44537a74043d2752e33c8, user_id=5b38c7211ed94a28a3b6c8fd17cec263, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:43.237515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0621ef-d33c-4269-a812-8aa945895316 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:43.247095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414147c-6871-411e-92f8-04ad47a64dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:43.248561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414147c-6871-411e-92f8-04ad47a64dc1 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:43.274632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 811/1624] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:43 2022] PUT /identity/v3/projects/dddc1bfd80f44537a74043d2752e33c8/users/5b38c7211ed94a28a3b6c8fd17cec263/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:43.276124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0621ef-d33c-4269-a812-8aa945895316 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.280172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 814/1625] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:43.286727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414147c-6871-411e-92f8-04ad47a64dc1 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.306862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414147c-6871-411e-92f8-04ad47a64dc1 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:43.402885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0621ef-d33c-4269-a812-8aa945895316 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:43.416336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23677841-e482-40f5-b75b-6b22526abf8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:43.417016 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23677841-e482-40f5-b75b-6b22526abf8c service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.417313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23677841-e482-40f5-b75b-6b22526abf8c service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.417595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23677841-e482-40f5-b75b-6b22526abf8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.422722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0ffb2-f918-400c-ba93-b8448d86f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:43.423416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ffb2-f918-400c-ba93-b8448d86f605 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.423703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ffb2-f918-400c-ba93-b8448d86f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.424531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ffb2-f918-400c-ba93-b8448d86f605 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.425234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ffb2-f918-400c-ba93-b8448d86f605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:43.427377 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0ffb2-f918-400c-ba93-b8448d86f605 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:43.518752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23677841-e482-40f5-b75b-6b22526abf8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:43.521168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23677841-e482-40f5-b75b-6b22526abf8c service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:43.531751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 815/1626] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:43 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:43.535135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ae58-8142-4903-84c0-ac0695025815 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.542023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ae58-8142-4903-84c0-ac0695025815 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.542450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ae58-8142-4903-84c0-ac0695025815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.555135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 812/1627] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:43.556200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23677841-e482-40f5-b75b-6b22526abf8c service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.585316 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23677841-e482-40f5-b75b-6b22526abf8c service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:43.599329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c95f-56df-47b3-a3f3-07260942639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:43.600355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c95f-56df-47b3-a3f3-07260942639b admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.600535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c95f-56df-47b3-a3f3-07260942639b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.600643 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b9a4ae58-8142-4903-84c0-ac0695025815 None None] MFA Rules not processed for user `5b38c7211ed94a28a3b6c8fd17cec263`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:43.600939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858c95f-56df-47b3-a3f3-07260942639b admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.601777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c95f-56df-47b3-a3f3-07260942639b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:43.602095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b9a4ae58-8142-4903-84c0-ac0695025815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:43.603642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858c95f-56df-47b3-a3f3-07260942639b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:43.643747 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 813/1628] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:43.649530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c95f-56df-47b3-a3f3-07260942639b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.686859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858c95f-56df-47b3-a3f3-07260942639b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:43.706326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3394d90-ef88-43a6-888f-8cf5ca42c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:43.707275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3394d90-ef88-43a6-888f-8cf5ca42c20c admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.709085 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3394d90-ef88-43a6-888f-8cf5ca42c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.709560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3394d90-ef88-43a6-888f-8cf5ca42c20c admin admin] PATH_INFO: `/v3/projects/887af87dab6345d19b9592d53de44fc2/users/d4906678e53347ac84fe696c54c124a3/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:43.741388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 816/1629] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:43.753219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3394d90-ef88-43a6-888f-8cf5ca42c20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=887af87dab6345d19b9592d53de44fc2, user_id=d4906678e53347ac84fe696c54c124a3, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:43.756711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3394d90-ef88-43a6-888f-8cf5ca42c20c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:43.756861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ae58-8142-4903-84c0-ac0695025815 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.843420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 814/1630] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:43 2022] PUT /identity/v3/projects/887af87dab6345d19b9592d53de44fc2/users/d4906678e53347ac84fe696c54c124a3/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:43.848301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3394d90-ef88-43a6-888f-8cf5ca42c20c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:43.875532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ae58-8142-4903-84c0-ac0695025815 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:43.941579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da43823-0c73-491d-9393-94bf2c3665bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:43.942860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da43823-0c73-491d-9393-94bf2c3665bd service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:43.942860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da43823-0c73-491d-9393-94bf2c3665bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:43.943270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da43823-0c73-491d-9393-94bf2c3665bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:44.001007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3394d90-ef88-43a6-888f-8cf5ca42c20c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:44.011471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94529f-d54c-404a-b63c-8351395e4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:44.013384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94529f-d54c-404a-b63c-8351395e4988 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:44.017442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94529f-d54c-404a-b63c-8351395e4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:44.017442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94529f-d54c-404a-b63c-8351395e4988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:44.017442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94529f-d54c-404a-b63c-8351395e4988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:44.021912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94529f-d54c-404a-b63c-8351395e4988 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:44.036882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da43823-0c73-491d-9393-94bf2c3665bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:44.046105 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da43823-0c73-491d-9393-94bf2c3665bd service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:44.051483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 815/1631] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:44.056641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94529f-d54c-404a-b63c-8351395e4988 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:44.067019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 817/1632] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:43 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:38:44.075643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94529f-d54c-404a-b63c-8351395e4988 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:44.076201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471242f0-f128-481d-845a-a2814b58f4b3 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:44.076513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471242f0-f128-481d-845a-a2814b58f4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:44.076788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471242f0-f128-481d-845a-a2814b58f4b3 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:44.078156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 818/1633] 10.222.0.43 () {54 vars in 912 bytes} [Thu Apr 28 16:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:38:44.083466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46fe69-f3d2-4146-b560-66a98deaa527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:44.084662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847bd0d-087d-472d-be0b-5bb77ae7be6d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:44.084944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847bd0d-087d-472d-be0b-5bb77ae7be6d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:44.085222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847bd0d-087d-472d-be0b-5bb77ae7be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:44.087802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46fe69-f3d2-4146-b560-66a98deaa527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:44.088178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46fe69-f3d2-4146-b560-66a98deaa527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:44.088531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46fe69-f3d2-4146-b560-66a98deaa527 admin admin] PATH_INFO: `/v3/projects/887af87dab6345d19b9592d53de44fc2/users/d4906678e53347ac84fe696c54c124a3/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:44.090805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46fe69-f3d2-4146-b560-66a98deaa527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887af87dab6345d19b9592d53de44fc2, user_id=d4906678e53347ac84fe696c54c124a3, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:44.094045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46fe69-f3d2-4146-b560-66a98deaa527 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:44.107915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f847bd0d-087d-472d-be0b-5bb77ae7be6d None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:44.118603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f847bd0d-087d-472d-be0b-5bb77ae7be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:44.118966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 816/1634] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:44 2022] PUT /identity/v3/projects/887af87dab6345d19b9592d53de44fc2/users/d4906678e53347ac84fe696c54c124a3/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:44.121384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cce1-973a-45ed-8c64-e0bfdc7a6d08 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:44.121763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cce1-973a-45ed-8c64-e0bfdc7a6d08 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:44.122124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cce1-973a-45ed-8c64-e0bfdc7a6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:44.153678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-40e9cce1-973a-45ed-8c64-e0bfdc7a6d08 None None] MFA Rules not processed for user `d4906678e53347ac84fe696c54c124a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:44.167934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-40e9cce1-973a-45ed-8c64-e0bfdc7a6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:44.227371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 819/1635] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:38:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:38:44.250597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847bd0d-087d-472d-be0b-5bb77ae7be6d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:44.274742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 817/1636] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:38:44.315650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847bd0d-087d-472d-be0b-5bb77ae7be6d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:44.319562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af7437-6572-4a8b-a4e8-97e58f6dcee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:44.320427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af7437-6572-4a8b-a4e8-97e58f6dcee5 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:44.320581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af7437-6572-4a8b-a4e8-97e58f6dcee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:44.320944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af7437-6572-4a8b-a4e8-97e58f6dcee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:44.332998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af7437-6572-4a8b-a4e8-97e58f6dcee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:44.334458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af7437-6572-4a8b-a4e8-97e58f6dcee5 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:44.346099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 820/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:44.732009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cce1-973a-45ed-8c64-e0bfdc7a6d08 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:44.746452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cce1-973a-45ed-8c64-e0bfdc7a6d08 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:44.761080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df586746-d60d-41bd-a2e2-7ed78e3490ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:44.761768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df586746-d60d-41bd-a2e2-7ed78e3490ed service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:44.762058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df586746-d60d-41bd-a2e2-7ed78e3490ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:44.762340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df586746-d60d-41bd-a2e2-7ed78e3490ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:44.784530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df586746-d60d-41bd-a2e2-7ed78e3490ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:44.789357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df586746-d60d-41bd-a2e2-7ed78e3490ed service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:44.806918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 818/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:45.158841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf242c-10a1-47de-b3ca-3f6cd89a5ddb None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:45.159527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf242c-10a1-47de-b3ca-3f6cd89a5ddb None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:45.159527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf242c-10a1-47de-b3ca-3f6cd89a5ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:45.203265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8cbf242c-10a1-47de-b3ca-3f6cd89a5ddb None None] MFA Rules not processed for user `a3de084ad4bc44239b89fab61a60dcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:45.205848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8cbf242c-10a1-47de-b3ca-3f6cd89a5ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:45.258248 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df586746-d60d-41bd-a2e2-7ed78e3490ed service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:45.269294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df586746-d60d-41bd-a2e2-7ed78e3490ed service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:45.275011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0883bef-006e-4ddc-a512-1560e3e62d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:45.275806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0883bef-006e-4ddc-a512-1560e3e62d70 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:45.276156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0883bef-006e-4ddc-a512-1560e3e62d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:45.276495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0883bef-006e-4ddc-a512-1560e3e62d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:45.359686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0883bef-006e-4ddc-a512-1560e3e62d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:45.361356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0883bef-006e-4ddc-a512-1560e3e62d70 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:45.380257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 819/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:45.381759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 821/1640] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:45.395159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b70b-78e0-4ed2-b197-857a6047dea9 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:45.395547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b70b-78e0-4ed2-b197-857a6047dea9 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:45.395866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8b70b-78e0-4ed2-b197-857a6047dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:45.420258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b3f8b70b-78e0-4ed2-b197-857a6047dea9 None None] MFA Rules not processed for user `a3de084ad4bc44239b89fab61a60dcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:45.421916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b3f8b70b-78e0-4ed2-b197-857a6047dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:45.435663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 820/1641] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:45.466561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb297a0-4270-4680-bbfc-0eb0dcba8046 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:45.466877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb297a0-4270-4680-bbfc-0eb0dcba8046 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:45.471522 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb297a0-4270-4680-bbfc-0eb0dcba8046 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:45.471522 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 822/1642] 10.222.0.43 () {54 vars in 960 bytes} [Thu Apr 28 16:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:38:45.476448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93201-fc84-423a-b993-2ecdb226ea79 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:45.476830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93201-fc84-423a-b993-2ecdb226ea79 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:45.477203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93201-fc84-423a-b993-2ecdb226ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:45.506213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7dd93201-fc84-423a-b993-2ecdb226ea79 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:45.508088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7dd93201-fc84-423a-b993-2ecdb226ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:45.543976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb297a0-4270-4680-bbfc-0eb0dcba8046 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:45.546974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 821/1643] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Apr 28 16:38:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:45.562932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb297a0-4270-4680-bbfc-0eb0dcba8046 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:45.569774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdeab21-32ad-4824-aba9-e652461abcd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:45.570526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeab21-32ad-4824-aba9-e652461abcd4 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:45.570920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeab21-32ad-4824-aba9-e652461abcd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:45.571430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeab21-32ad-4824-aba9-e652461abcd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:45.594905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdeab21-32ad-4824-aba9-e652461abcd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:45.597911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdeab21-32ad-4824-aba9-e652461abcd4 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:45.620632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 823/1644] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:38:46.095810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f295-605d-4f73-86e4-5e3abb9af13c None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:46.096366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f295-605d-4f73-86e4-5e3abb9af13c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:46.096750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919f295-605d-4f73-86e4-5e3abb9af13c None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:46.098340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 822/1645] 10.222.0.43 () {54 vars in 912 bytes} [Thu Apr 28 16:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:38:46.105920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02810ba5-0ed1-40ba-84b1-05cde94db739 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:46.105920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02810ba5-0ed1-40ba-84b1-05cde94db739 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:46.105920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02810ba5-0ed1-40ba-84b1-05cde94db739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:46.134767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-02810ba5-0ed1-40ba-84b1-05cde94db739 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:46.136099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-02810ba5-0ed1-40ba-84b1-05cde94db739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:46.150615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 824/1646] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:38:46.167154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919f295-605d-4f73-86e4-5e3abb9af13c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:46.173286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7919f295-605d-4f73-86e4-5e3abb9af13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:46.330991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919f295-605d-4f73-86e4-5e3abb9af13c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:46.342586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc4a2f-37c2-4d39-87a2-630005b5f30f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f2a360a89548208edd5fdff1a04e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:46.343271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc4a2f-37c2-4d39-87a2-630005b5f30f service glance] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:46.343564 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc4a2f-37c2-4d39-87a2-630005b5f30f service glance] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:46.350746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc4a2f-37c2-4d39-87a2-630005b5f30f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:46.375206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc4a2f-37c2-4d39-87a2-630005b5f30f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:46.379405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc4a2f-37c2-4d39-87a2-630005b5f30f service glance] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:46.400318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 823/1647] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:46.814027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02810ba5-0ed1-40ba-84b1-05cde94db739 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:46.920475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02810ba5-0ed1-40ba-84b1-05cde94db739 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:46.927027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:46.927992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:46.928570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:46.928861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] PATH_INFO: `/v3/users/2bd92566dbce48b29f16e818cae257c4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:46.930205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd92566dbce48b29f16e818cae257c4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:46.932649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:47.220190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd92566dbce48b29f16e818cae257c4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:47.248667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd92566dbce48b29f16e818cae257c4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:47.248667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd92566dbce48b29f16e818cae257c4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:47.248667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd92566dbce48b29f16e818cae257c4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:47.339390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-eb9d8042-186f-4a47-a9d7-64037a079a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd92566dbce48b29f16e818cae257c4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:47.350040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e97aa-4817-4c84-9d30-d9f73328d8a8 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:47.350927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e97aa-4817-4c84-9d30-d9f73328d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:47.353680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e97aa-4817-4c84-9d30-d9f73328d8a8 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:47.353680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 824/1648] 10.222.0.43 () {54 vars in 912 bytes} [Thu Apr 28 16:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 28 16:38:47.364274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068a71-5f89-48be-bd05-f413acd6d32b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:47.364968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068a71-5f89-48be-bd05-f413acd6d32b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:47.365442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068a71-5f89-48be-bd05-f413acd6d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:47.390886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 825/1649] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:38:46 2022] DELETE /identity/v3/users/2bd92566dbce48b29f16e818cae257c4 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:47.396948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8ae72-06a1-4504-837e-d81f438fa7e1 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:47.397339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8ae72-06a1-4504-837e-d81f438fa7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:47.397646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8ae72-06a1-4504-837e-d81f438fa7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:47.442921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1ad8ae72-06a1-4504-837e-d81f438fa7e1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:47.447523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1ad8ae72-06a1-4504-837e-d81f438fa7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:47.450881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6a068a71-5f89-48be-bd05-f413acd6d32b None None] MFA Rules not processed for user `ebf1f55dbef94868aaac6d39ed70690b`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:47.451424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6a068a71-5f89-48be-bd05-f413acd6d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:47.553175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 825/1650] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:38:47.607649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 826/1651] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:47.645392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068a71-5f89-48be-bd05-f413acd6d32b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:47.645893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8ae72-06a1-4504-837e-d81f438fa7e1 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:47.647487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6a068a71-5f89-48be-bd05-f413acd6d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:47.650414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1ad8ae72-06a1-4504-837e-d81f438fa7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:47.661461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068a71-5f89-48be-bd05-f413acd6d32b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:47.672153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8ae72-06a1-4504-837e-d81f438fa7e1 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:47.672398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:47.672846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:47.673149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:47.673461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:47.690269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c888056-98b6-485f-a4b4-da55600175b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:47.690269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c888056-98b6-485f-a4b4-da55600175b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:47.690269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c888056-98b6-485f-a4b4-da55600175b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:47.690269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c888056-98b6-485f-a4b4-da55600175b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:47.694862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:47.699110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:47.707371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c888056-98b6-485f-a4b4-da55600175b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:47.709495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c888056-98b6-485f-a4b4-da55600175b8 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:47.719744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 826/1652] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:47.734454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 827/1653] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:38:48.833409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:48.834992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:48.860800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45535be4-7dd4-4dc2-92b5-86401d247921 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:48.879064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:48.879779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:48.880071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:48.880354 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] PATH_INFO: `/v3/users/e04c5ab5dd08474d860712151943f04b` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:48.885882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04c5ab5dd08474d860712151943f04b)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:48.894198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: WARNING py.warnings [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:38:48.894198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: warnings.warn(msg) Apr 28 16:38:48.894198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: Apr 28 16:38:48.895604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:49.167726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04c5ab5dd08474d860712151943f04b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:49.168749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04c5ab5dd08474d860712151943f04b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:49.200459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04c5ab5dd08474d860712151943f04b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:49.203208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04c5ab5dd08474d860712151943f04b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:49.333423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33bf20bc-2826-46d9-84b1-5a4c09b10dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04c5ab5dd08474d860712151943f04b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:49.415215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 827/1654] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:38:48 2022] DELETE /identity/v3/users/e04c5ab5dd08474d860712151943f04b => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:49.416786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f6c1a-3ed7-48ba-96f0-53a6d13e3808 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:49.417518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f6c1a-3ed7-48ba-96f0-53a6d13e3808 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:49.417518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f6c1a-3ed7-48ba-96f0-53a6d13e3808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:49.429487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d004b-6b80-4a99-abb9-e3f8e13ac286 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:49.429857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d004b-6b80-4a99-abb9-e3f8e13ac286 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:49.430220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d004b-6b80-4a99-abb9-e3f8e13ac286 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:49.432044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 828/1655] 10.222.0.43 () {54 vars in 960 bytes} [Thu Apr 28 16:38:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:38:49.449791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cb46-3186-4fe9-8e91-6df0c301bcef None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:49.450372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cb46-3186-4fe9-8e91-6df0c301bcef None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:49.451142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87cb46-3186-4fe9-8e91-6df0c301bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:49.459120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4b9f6c1a-3ed7-48ba-96f0-53a6d13e3808 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:49.464938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4b9f6c1a-3ed7-48ba-96f0-53a6d13e3808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:49.501449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1c87cb46-3186-4fe9-8e91-6df0c301bcef None None] MFA Rules not processed for user `ded012db549b45669a4ffcdd988b55ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:49.509853 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1c87cb46-3186-4fe9-8e91-6df0c301bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:49.712062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 828/1656] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:49.712947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f6c1a-3ed7-48ba-96f0-53a6d13e3808 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:49.719758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4b9f6c1a-3ed7-48ba-96f0-53a6d13e3808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:49.755911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 829/1657] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Apr 28 16:38:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:38:49.756820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87cb46-3186-4fe9-8e91-6df0c301bcef None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:49.760146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f6c1a-3ed7-48ba-96f0-53a6d13e3808 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:49.761246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1c87cb46-3186-4fe9-8e91-6df0c301bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:49.780217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:49.781106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:49.781394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:49.781673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] PATH_INFO: `/v3/projects/c1a16f50ada34caf8ebc452c5c6c7e41` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:49.786563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a16f50ada34caf8ebc452c5c6c7e41)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:49.787620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: WARNING py.warnings [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 28 16:38:49.787620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: warnings.warn(msg) Apr 28 16:38:49.787620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: Apr 28 16:38:49.788830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:49.912701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87cb46-3186-4fe9-8e91-6df0c301bcef None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:49.934974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b085ea-84fe-4d16-912e-87ade227ebbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:49.936917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b085ea-84fe-4d16-912e-87ade227ebbb service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:49.937862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b085ea-84fe-4d16-912e-87ade227ebbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:49.938576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b085ea-84fe-4d16-912e-87ade227ebbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:49.970015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b085ea-84fe-4d16-912e-87ade227ebbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:49.974491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b085ea-84fe-4d16-912e-87ade227ebbb service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:50.016397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 830/1658] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:50.019756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b085ea-84fe-4d16-912e-87ade227ebbb service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:50.056218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b085ea-84fe-4d16-912e-87ade227ebbb service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:50.071615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a16f50ada34caf8ebc452c5c6c7e41', 'request_id': 'req-39496671-e29f-4794-a248-3ea54b96f36c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.144991 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a16f50ada34caf8ebc452c5c6c7e41', 'request_id': 'req-39496671-e29f-4794-a248-3ea54b96f36c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.154796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a16f50ada34caf8ebc452c5c6c7e41', 'request_id': 'req-39496671-e29f-4794-a248-3ea54b96f36c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.219833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] The token cache is being invalidate because project c1a16f50ada34caf8ebc452c5c6c7e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:38:50.221515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.223774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.224244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded012db549b45669a4ffcdd988b55ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:50.225098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:50.225247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:50.233460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:50.234737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 829/1659] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:38:49 2022] DELETE /identity/v3/projects/c1a16f50ada34caf8ebc452c5c6c7e41 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:50.238638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:50.240274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:50.243794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:50.279973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:50.281628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:50.308922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 831/1660] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:50.396890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39496671-e29f-4794-a248-3ea54b96f36c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:50.412885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:50.413791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:50.414096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:50.414347 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] PATH_INFO: `/v3/users/5b38c7211ed94a28a3b6c8fd17cec263` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:50.418006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b38c7211ed94a28a3b6c8fd17cec263)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:50.419287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:50.747117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b38c7211ed94a28a3b6c8fd17cec263'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.807645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b38c7211ed94a28a3b6c8fd17cec263'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.809768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b38c7211ed94a28a3b6c8fd17cec263'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.810576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b38c7211ed94a28a3b6c8fd17cec263'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.889515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:50.891311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:50.907333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d0ec4147-8f60-478a-861c-b16f31cb103b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b38c7211ed94a28a3b6c8fd17cec263'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:50.927336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490985-a5c7-4231-b328-99788be76be2 service placement] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:50.951045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:50.966634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:50.967080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:50.967451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] PATH_INFO: `/v3/projects/6a21a2af9f474ecca0a8c21f2ded2e03` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:50.980253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a21a2af9f474ecca0a8c21f2ded2e03)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:50.980253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:51.007685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 830/1661] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:38:50 2022] DELETE /identity/v3/users/5b38c7211ed94a28a3b6c8fd17cec263 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:51.154578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a21a2af9f474ecca0a8c21f2ded2e03', 'request_id': 'req-4bbc343e-2182-4b9a-a0de-d6027866a12f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:51.270134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a21a2af9f474ecca0a8c21f2ded2e03', 'request_id': 'req-4bbc343e-2182-4b9a-a0de-d6027866a12f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:51.276913 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a21a2af9f474ecca0a8c21f2ded2e03', 'request_id': 'req-4bbc343e-2182-4b9a-a0de-d6027866a12f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:51.301553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] The token cache is being invalidate because project 6a21a2af9f474ecca0a8c21f2ded2e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:38:51.302145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:51.303908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4bbc343e-2182-4b9a-a0de-d6027866a12f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:51.308615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 832/1662] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:38:50 2022] DELETE /identity/v3/projects/6a21a2af9f474ecca0a8c21f2ded2e03 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:51.314177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac2f7-9659-47f6-98aa-d73ca75b5a85 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:51.315183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac2f7-9659-47f6-98aa-d73ca75b5a85 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:51.315569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac2f7-9659-47f6-98aa-d73ca75b5a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:51.417306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ec8ac2f7-9659-47f6-98aa-d73ca75b5a85 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:51.428943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ec8ac2f7-9659-47f6-98aa-d73ca75b5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:51.615077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 831/1663] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:51.616252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fc23a-803f-4fdb-b2a6-a5f95faf19b6 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:51.616657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fc23a-803f-4fdb-b2a6-a5f95faf19b6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:51.617050 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fc23a-803f-4fdb-b2a6-a5f95faf19b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:51.647088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ac6fc23a-803f-4fdb-b2a6-a5f95faf19b6 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:51.648453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ac6fc23a-803f-4fdb-b2a6-a5f95faf19b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:51.668145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 833/1664] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:51.672054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac2f7-9659-47f6-98aa-d73ca75b5a85 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:51.693350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac2f7-9659-47f6-98aa-d73ca75b5a85 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:51.707654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:51.713215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:51.713215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:51.713215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:51.713215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:51.713215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:51.713215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:51.770217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 832/1665] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:51.770325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fc23a-803f-4fdb-b2a6-a5f95faf19b6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:51.799692 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fc23a-803f-4fdb-b2a6-a5f95faf19b6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:51.810807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:51.812536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:51.836136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ccd2-43eb-43dd-bc80-cc15b2b6e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:51.836834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ccd2-43eb-43dd-bc80-cc15b2b6e94c admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:51.837127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ccd2-43eb-43dd-bc80-cc15b2b6e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:51.837406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54ccd2-43eb-43dd-bc80-cc15b2b6e94c admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:51.838609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54ccd2-43eb-43dd-bc80-cc15b2b6e94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:51.840124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54ccd2-43eb-43dd-bc80-cc15b2b6e94c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:51.849242 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488382bd-9064-4a1e-9e2d-797a70ba990a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:51.865828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:51.866752 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:51.867047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:51.867335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] PATH_INFO: `/v3/projects/dddc1bfd80f44537a74043d2752e33c8` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:51.874810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=dddc1bfd80f44537a74043d2752e33c8)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:51.882168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:51.994660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 834/1666] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:51 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:52.003505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ccd2-43eb-43dd-bc80-cc15b2b6e94c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:52.063074 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dddc1bfd80f44537a74043d2752e33c8', 'request_id': 'req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:52.137380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54ccd2-43eb-43dd-bc80-cc15b2b6e94c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:52.167086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dddc1bfd80f44537a74043d2752e33c8', 'request_id': 'req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:52.174576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dddc1bfd80f44537a74043d2752e33c8', 'request_id': 'req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:52.205565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] The token cache is being invalidate because project dddc1bfd80f44537a74043d2752e33c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:38:52.213095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:52.217408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-11bd1813-9b14-4d2f-8ce0-65da7ac09fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:52.219723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 833/1667] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:38:51 2022] DELETE /identity/v3/projects/dddc1bfd80f44537a74043d2752e33c8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:38:52.236375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02734ad-d327-4bc4-add0-7851ffd2a24a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.237181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02734ad-d327-4bc4-add0-7851ffd2a24a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.237479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02734ad-d327-4bc4-add0-7851ffd2a24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.248043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:52.248975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.250632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.253276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.254292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:52.256335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:52.277617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f02734ad-d327-4bc4-add0-7851ffd2a24a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:52.279152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f02734ad-d327-4bc4-add0-7851ffd2a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:52.303240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 834/1668] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:52.305083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97d36-8981-4408-87ae-25b1256b462a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.305586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97d36-8981-4408-87ae-25b1256b462a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.306064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97d36-8981-4408-87ae-25b1256b462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.342655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-cfb97d36-8981-4408-87ae-25b1256b462a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:52.343998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cfb97d36-8981-4408-87ae-25b1256b462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:52.359456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 835/1669] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:52.370704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 835/1670] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:51 2022] POST /identity/v3/users => generated 288 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:52.372172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb97d36-8981-4408-87ae-25b1256b462a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:52.373496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:52.379442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:52.400669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb97d36-8981-4408-87ae-25b1256b462a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:52.409469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc259739-cd8f-4f77-bdf9-3a3438230d65 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:52.413888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:52.415114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.416669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.417558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.418958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:52.419704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:52.422060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5031be-c2a7-42de-b11a-87fbfe4f599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:52.423141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:52.423980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5031be-c2a7-42de-b11a-87fbfe4f599c admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.424366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5031be-c2a7-42de-b11a-87fbfe4f599c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.427068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5031be-c2a7-42de-b11a-87fbfe4f599c admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.428110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5031be-c2a7-42de-b11a-87fbfe4f599c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:52.431055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5031be-c2a7-42de-b11a-87fbfe4f599c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:52.453660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 836/1671] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:38:52.455912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:52.456161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 836/1672] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:52.457732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5031be-c2a7-42de-b11a-87fbfe4f599c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:52.483270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0468-f678-4361-9197-148e3b921de1 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:52.483599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5031be-c2a7-42de-b11a-87fbfe4f599c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:52.491134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167438-be23-44ff-b021-fa847af438b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:52.492298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167438-be23-44ff-b021-fa847af438b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.493389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167438-be23-44ff-b021-fa847af438b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.494274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7ec89-3c75-410d-b879-8e7fa3652556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:52.495082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ec89-3c75-410d-b879-8e7fa3652556 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.495555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167438-be23-44ff-b021-fa847af438b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.496632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ec89-3c75-410d-b879-8e7fa3652556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.497014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7ec89-3c75-410d-b879-8e7fa3652556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.497291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167438-be23-44ff-b021-fa847af438b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:52.498140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7ec89-3c75-410d-b879-8e7fa3652556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:52.503577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167438-be23-44ff-b021-fa847af438b7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:52.505045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7ec89-3c75-410d-b879-8e7fa3652556 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:52.534074 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 837/1673] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:52.537302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167438-be23-44ff-b021-fa847af438b7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:52.549965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167438-be23-44ff-b021-fa847af438b7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:52.557710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67a558-2e06-4570-aef5-b18ce80eafe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:52.557710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67a558-2e06-4570-aef5-b18ce80eafe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.557710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67a558-2e06-4570-aef5-b18ce80eafe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.557710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67a558-2e06-4570-aef5-b18ce80eafe6 admin admin] PATH_INFO: `/v3/projects/89066535b6ac497cbc45014061844655/users/430477f936a9453f999b23083535bcba/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.575765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67a558-2e06-4570-aef5-b18ce80eafe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89066535b6ac497cbc45014061844655, user_id=430477f936a9453f999b23083535bcba, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:52.579034 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67a558-2e06-4570-aef5-b18ce80eafe6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:52.652168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 837/1674] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:52 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:52.656192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7ec89-3c75-410d-b879-8e7fa3652556 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:52.676900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 838/1675] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:52 2022] PUT /identity/v3/projects/89066535b6ac497cbc45014061844655/users/430477f936a9453f999b23083535bcba/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:38:52.692054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d872-4ff4-4da8-b5f2-549abff90864 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.693294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d872-4ff4-4da8-b5f2-549abff90864 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.693595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0d872-4ff4-4da8-b5f2-549abff90864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.777366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-aac0d872-4ff4-4da8-b5f2-549abff90864 None None] MFA Rules not processed for user `430477f936a9453f999b23083535bcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:52.779101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-aac0d872-4ff4-4da8-b5f2-549abff90864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:52.820654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7ec89-3c75-410d-b879-8e7fa3652556 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:52.879092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 839/1676] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:52.900966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d872-4ff4-4da8-b5f2-549abff90864 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:52.903421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-aac0d872-4ff4-4da8-b5f2-549abff90864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:52.920982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27dec-26a1-4567-903b-dad2856e76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:52.921689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27dec-26a1-4567-903b-dad2856e76ac admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:52.921977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27dec-26a1-4567-903b-dad2856e76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:52.922260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27dec-26a1-4567-903b-dad2856e76ac admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:52.923014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed27dec-26a1-4567-903b-dad2856e76ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:52.925484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed27dec-26a1-4567-903b-dad2856e76ac admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:53.054490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 838/1677] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:52 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:53.059810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27dec-26a1-4567-903b-dad2856e76ac admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:53.068828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0d872-4ff4-4da8-b5f2-549abff90864 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:53.083345 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c653-defc-4b39-846c-ee59c361281e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:53.084775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c653-defc-4b39-846c-ee59c361281e service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:53.086633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c653-defc-4b39-846c-ee59c361281e service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:53.086633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209c653-defc-4b39-846c-ee59c361281e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:53.086932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27dec-26a1-4567-903b-dad2856e76ac admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:53.107290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c69b6-1429-4221-8006-59a877a334f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:53.107964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209c653-defc-4b39-846c-ee59c361281e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:53.108110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c69b6-1429-4221-8006-59a877a334f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:53.108770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c69b6-1429-4221-8006-59a877a334f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:53.109068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c69b6-1429-4221-8006-59a877a334f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:53.109992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c69b6-1429-4221-8006-59a877a334f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:53.112232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c69b6-1429-4221-8006-59a877a334f6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:53.113462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209c653-defc-4b39-846c-ee59c361281e service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:53.142099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 840/1678] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:53.143307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c653-defc-4b39-846c-ee59c361281e service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:53.144042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 839/1679] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:38:53.168376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209c653-defc-4b39-846c-ee59c361281e service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:53.183510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ac51b-8d94-49d9-a996-ab40d826e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:53.184399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ac51b-8d94-49d9-a996-ab40d826e0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:53.184949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ac51b-8d94-49d9-a996-ab40d826e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:53.185376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ac51b-8d94-49d9-a996-ab40d826e0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:53.186283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ac51b-8d94-49d9-a996-ab40d826e0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:53.188373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ac51b-8d94-49d9-a996-ab40d826e0ba admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:53.211411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 841/1680] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:53.215479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c69b6-1429-4221-8006-59a877a334f6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:53.231843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c69b6-1429-4221-8006-59a877a334f6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:53.250504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28eeb8-c348-4a18-acac-9cde5003fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:53.251631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28eeb8-c348-4a18-acac-9cde5003fb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:53.252024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28eeb8-c348-4a18-acac-9cde5003fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:53.255949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28eeb8-c348-4a18-acac-9cde5003fb45 admin admin] PATH_INFO: `/v3/projects/b79dca280bac4eb3b4b1786600cb95bf/users/f9487eaa9dca45d1aa272525183335f5/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:53.295807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28eeb8-c348-4a18-acac-9cde5003fb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79dca280bac4eb3b4b1786600cb95bf, user_id=f9487eaa9dca45d1aa272525183335f5, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:53.302111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28eeb8-c348-4a18-acac-9cde5003fb45 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:53.403334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ac51b-8d94-49d9-a996-ab40d826e0ba admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:53.411567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 840/1681] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:53 2022] PUT /identity/v3/projects/b79dca280bac4eb3b4b1786600cb95bf/users/f9487eaa9dca45d1aa272525183335f5/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:38:53.422243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035511-dbe5-4439-80ba-151669bbb111 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:53.422845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035511-dbe5-4439-80ba-151669bbb111 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:53.423261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035511-dbe5-4439-80ba-151669bbb111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:53.429169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ac51b-8d94-49d9-a996-ab40d826e0ba admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:53.462259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-15035511-dbe5-4439-80ba-151669bbb111 None None] MFA Rules not processed for user `f9487eaa9dca45d1aa272525183335f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:53.464136 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-15035511-dbe5-4439-80ba-151669bbb111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:53.543763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 841/1682] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:53.544979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035511-dbe5-4439-80ba-151669bbb111 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:53.546583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:53.547780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:53.548608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:53.548811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] PATH_INFO: `/v3/users/430477f936a9453f999b23083535bcba` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:53.550047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=430477f936a9453f999b23083535bcba)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:53.552824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:53.556013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035511-dbe5-4439-80ba-151669bbb111 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:53.561422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129803-cafc-443b-834b-fb6f37fba3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:53.562280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129803-cafc-443b-834b-fb6f37fba3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:53.562741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129803-cafc-443b-834b-fb6f37fba3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:53.565877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129803-cafc-443b-834b-fb6f37fba3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:53.565877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33129803-cafc-443b-834b-fb6f37fba3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:53.566370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33129803-cafc-443b-834b-fb6f37fba3e7 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:53.684418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 842/1683] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:53 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:53.689508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129803-cafc-443b-834b-fb6f37fba3e7 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:53.801911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430477f936a9453f999b23083535bcba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:53.805512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430477f936a9453f999b23083535bcba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:53.840556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430477f936a9453f999b23083535bcba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:53.850293 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430477f936a9453f999b23083535bcba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:53.895572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129803-cafc-443b-834b-fb6f37fba3e7 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:53.927978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:53.928497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:53.928788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:53.929181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:53.929783 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:53.931947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:53.962882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-732fa256-1f8a-4ae5-a0bd-031d3b7383a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430477f936a9453f999b23083535bcba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:54.027542 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 842/1684] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:38:53 2022] DELETE /identity/v3/users/430477f936a9453f999b23083535bcba => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:38:54.030091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caed7a3-6d6b-4017-832b-4bc4d80ec24e None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:54.030668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caed7a3-6d6b-4017-832b-4bc4d80ec24e None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:54.031355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caed7a3-6d6b-4017-832b-4bc4d80ec24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:54.066732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1caed7a3-6d6b-4017-832b-4bc4d80ec24e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:54.069129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1caed7a3-6d6b-4017-832b-4bc4d80ec24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:54.076287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 843/1685] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:53 2022] POST /identity/v3/users => generated 300 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:38:54.081451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:54.086951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:54.120618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a0211-0c3d-405b-8798-9b2c1e207bff admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:54.160481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 843/1686] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:54.227821 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caed7a3-6d6b-4017-832b-4bc4d80ec24e None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:54.233056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1caed7a3-6d6b-4017-832b-4bc4d80ec24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:54.286302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e465-fcc8-4bbf-a207-0caa38e6e972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:54.287241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e465-fcc8-4bbf-a207-0caa38e6e972 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:54.287587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e465-fcc8-4bbf-a207-0caa38e6e972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:54.287954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8e465-fcc8-4bbf-a207-0caa38e6e972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:54.288822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8e465-fcc8-4bbf-a207-0caa38e6e972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:54.290751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8e465-fcc8-4bbf-a207-0caa38e6e972 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:54.331412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 844/1687] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:54.334601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e465-fcc8-4bbf-a207-0caa38e6e972 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:54.354352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8e465-fcc8-4bbf-a207-0caa38e6e972 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:54.372164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53c139-ccd9-4c05-9f3a-c0bd6bb65ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:54.373843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53c139-ccd9-4c05-9f3a-c0bd6bb65ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:54.374157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53c139-ccd9-4c05-9f3a-c0bd6bb65ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:54.375419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53c139-ccd9-4c05-9f3a-c0bd6bb65ed5 admin admin] PATH_INFO: `/v3/projects/805c4de1dd254d009436e56c58d9cac2/users/67089f2c0df54c0fa36bbeecce2e96ff/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:54.407770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caed7a3-6d6b-4017-832b-4bc4d80ec24e None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:54.412266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53c139-ccd9-4c05-9f3a-c0bd6bb65ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805c4de1dd254d009436e56c58d9cac2, user_id=67089f2c0df54c0fa36bbeecce2e96ff, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:54.423168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb16cc-1cea-4962-ae9b-2f75896a96b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:54.425020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53c139-ccd9-4c05-9f3a-c0bd6bb65ed5 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:54.425757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb16cc-1cea-4962-ae9b-2f75896a96b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:54.426058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb16cc-1cea-4962-ae9b-2f75896a96b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:54.426883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb16cc-1cea-4962-ae9b-2f75896a96b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:54.451898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb16cc-1cea-4962-ae9b-2f75896a96b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:54.453664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb16cc-1cea-4962-ae9b-2f75896a96b5 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:54.479185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 844/1688] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:54.511190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 845/1689] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:54 2022] PUT /identity/v3/projects/805c4de1dd254d009436e56c58d9cac2/users/67089f2c0df54c0fa36bbeecce2e96ff/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:54.514974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb16cc-1cea-4962-ae9b-2f75896a96b5 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:54.527219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb16cc-1cea-4962-ae9b-2f75896a96b5 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:54.669414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318471ca-0109-4ff4-89a3-d16aa403c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:54.670120 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318471ca-0109-4ff4-89a3-d16aa403c46d admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:54.670407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318471ca-0109-4ff4-89a3-d16aa403c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:54.670740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318471ca-0109-4ff4-89a3-d16aa403c46d admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:54.672648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318471ca-0109-4ff4-89a3-d16aa403c46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:54.678335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318471ca-0109-4ff4-89a3-d16aa403c46d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:54.702651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53c139-ccd9-4c05-9f3a-c0bd6bb65ed5 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:54.703314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 845/1690] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:38:54.721202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53c139-ccd9-4c05-9f3a-c0bd6bb65ed5 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:54.732180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:54.733163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:54.735626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:54.736670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] PATH_INFO: `/v3/projects/805c4de1dd254d009436e56c58d9cac2/users/67089f2c0df54c0fa36bbeecce2e96ff/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:54.740777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805c4de1dd254d009436e56c58d9cac2, user_id=67089f2c0df54c0fa36bbeecce2e96ff, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:54.745139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:54.781171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 846/1691] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:54 2022] PUT /identity/v3/projects/805c4de1dd254d009436e56c58d9cac2/users/67089f2c0df54c0fa36bbeecce2e96ff/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:54.793236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99acc7-dc93-4863-9533-32173616897b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:54.793693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99acc7-dc93-4863-9533-32173616897b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:54.794089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99acc7-dc93-4863-9533-32173616897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:54.845052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ba99acc7-dc93-4863-9533-32173616897b None None] MFA Rules not processed for user `67089f2c0df54c0fa36bbeecce2e96ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:54.847284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ba99acc7-dc93-4863-9533-32173616897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:54.974974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 846/1692] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:54.985362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:54.992240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:55.116780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761a346-22d6-4c5a-aaf7-a8c78d5f8c76 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:55.128616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:55.130013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:55.130562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:55.131037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:55.156564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:55.181735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:55.215104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 847/1693] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:55.414591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99acc7-dc93-4863-9533-32173616897b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:55.563488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99acc7-dc93-4863-9533-32173616897b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:55.571347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:55.574281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:55.574600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:55.574895 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] PATH_INFO: `/v3/users/f9487eaa9dca45d1aa272525183335f5` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:55.577978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9487eaa9dca45d1aa272525183335f5)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:55.583588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:55.739479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:55.741545 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:55.765104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136ee30-c6f4-4521-81c0-6f7b91940650 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:55.778103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:55.791650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:55.791650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:55.791650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] PATH_INFO: `/v3/projects/89066535b6ac497cbc45014061844655` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:55.791650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89066535b6ac497cbc45014061844655)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:55.791650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:55.900360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9487eaa9dca45d1aa272525183335f5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:55.901073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9487eaa9dca45d1aa272525183335f5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:55.930034 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9487eaa9dca45d1aa272525183335f5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:55.935960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9487eaa9dca45d1aa272525183335f5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:56.049289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-33a4a7f7-cfba-4b8a-a25e-169a65dbb87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9487eaa9dca45d1aa272525183335f5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:56.054358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89066535b6ac497cbc45014061844655', 'request_id': 'req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:56.094936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 847/1694] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:38:55 2022] DELETE /identity/v3/users/f9487eaa9dca45d1aa272525183335f5 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:56.097661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309439-4a1a-4d9e-8a2a-7b916f7aa393 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:56.097963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309439-4a1a-4d9e-8a2a-7b916f7aa393 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:56.098249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309439-4a1a-4d9e-8a2a-7b916f7aa393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:56.140632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89066535b6ac497cbc45014061844655', 'request_id': 'req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:56.147297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89066535b6ac497cbc45014061844655', 'request_id': 'req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:56.158337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-75309439-4a1a-4d9e-8a2a-7b916f7aa393 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:56.159611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-75309439-4a1a-4d9e-8a2a-7b916f7aa393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:56.174417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] The token cache is being invalidate because project 89066535b6ac497cbc45014061844655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:38:56.174748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:56.180253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f361f1f3-fd3f-4f09-98df-4a39f1075ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:56.183972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 848/1695] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:38:55 2022] DELETE /identity/v3/projects/89066535b6ac497cbc45014061844655 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:38:56.190556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573314b1-5e11-4813-af6b-1838db22c9c6 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:56.190871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573314b1-5e11-4813-af6b-1838db22c9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:56.191316 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573314b1-5e11-4813-af6b-1838db22c9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:56.250061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-573314b1-5e11-4813-af6b-1838db22c9c6 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:56.252007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-573314b1-5e11-4813-af6b-1838db22c9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:56.314526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 848/1696] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:38:56.339397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309439-4a1a-4d9e-8a2a-7b916f7aa393 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:56.341176 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-75309439-4a1a-4d9e-8a2a-7b916f7aa393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:56.384986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 849/1697] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:56.384986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4902d-26f9-4ea3-9b7b-1bf622c2da92 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:56.384986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4902d-26f9-4ea3-9b7b-1bf622c2da92 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:56.384986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4902d-26f9-4ea3-9b7b-1bf622c2da92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:56.420683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d8a4902d-26f9-4ea3-9b7b-1bf622c2da92 None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:56.421974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d8a4902d-26f9-4ea3-9b7b-1bf622c2da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:56.430771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309439-4a1a-4d9e-8a2a-7b916f7aa393 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:56.436703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416d1dd-b039-4701-9574-1d6ac77c4ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:56.437356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d1dd-b039-4701-9574-1d6ac77c4ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:56.437471 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d1dd-b039-4701-9574-1d6ac77c4ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:56.437676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416d1dd-b039-4701-9574-1d6ac77c4ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:56.448302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416d1dd-b039-4701-9574-1d6ac77c4ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:56.449811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416d1dd-b039-4701-9574-1d6ac77c4ba7 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:56.461594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 849/1698] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:56.474403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304cb1b-7298-42ec-813d-950e1cf1e200 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:56.474622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304cb1b-7298-42ec-813d-950e1cf1e200 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:56.479187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304cb1b-7298-42ec-813d-950e1cf1e200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:56.517818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f304cb1b-7298-42ec-813d-950e1cf1e200 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:56.519154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f304cb1b-7298-42ec-813d-950e1cf1e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:56.553169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 850/1699] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:56.559407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304cb1b-7298-42ec-813d-950e1cf1e200 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:56.574157 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304cb1b-7298-42ec-813d-950e1cf1e200 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:56.583060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 850/1700] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:38:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:56.588731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:56.589426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:56.589718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:56.590493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:56.590902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:38:56.591129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:56.592821 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:56.615467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 851/1701] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:38:56.620596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4902d-26f9-4ea3-9b7b-1bf622c2da92 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:56.637209 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4902d-26f9-4ea3-9b7b-1bf622c2da92 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:56.640879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:56.641664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:56.642024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:56.643344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:56.644291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:56.650003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:56.805235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 851/1702] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:56 2022] POST /identity/v3/projects => generated 389 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:56.806553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:56.821988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b80b4-6147-4a44-935b-5e8898328651 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:57.159623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030e39b-8887-4fb7-a774-cc6cfce3ef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:57.159769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030e39b-8887-4fb7-a774-cc6cfce3ef2d admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:57.165711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030e39b-8887-4fb7-a774-cc6cfce3ef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:57.166778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030e39b-8887-4fb7-a774-cc6cfce3ef2d admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:57.168855 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030e39b-8887-4fb7-a774-cc6cfce3ef2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:57.176005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:57.178286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:57.207280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030e39b-8887-4fb7-a774-cc6cfce3ef2d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:57.349068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 852/1703] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:56 2022] POST /identity/v3/users => generated 295 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:57.350842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030e39b-8887-4fb7-a774-cc6cfce3ef2d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:57.383874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030e39b-8887-4fb7-a774-cc6cfce3ef2d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:57.420761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffaca3-a9d2-4c5a-aa5c-612148ba3e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:57.421482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffaca3-a9d2-4c5a-aa5c-612148ba3e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:57.421823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffaca3-a9d2-4c5a-aa5c-612148ba3e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:57.422061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffaca3-a9d2-4c5a-aa5c-612148ba3e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:57.422884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffaca3-a9d2-4c5a-aa5c-612148ba3e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:57.434810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffaca3-a9d2-4c5a-aa5c-612148ba3e01 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:57.458810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494abe0-ce8a-453b-a7cd-efbf3acdcf2c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:57.460034 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 853/1704] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:57.460990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffaca3-a9d2-4c5a-aa5c-612148ba3e01 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:57.467146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bc4bd-00f1-41e4-8417-7615f010b044 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:57.467942 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc4bd-00f1-41e4-8417-7615f010b044 service swift] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:57.468343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc4bd-00f1-41e4-8417-7615f010b044 service swift] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:57.468717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bc4bd-00f1-41e4-8417-7615f010b044 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:57.482373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffaca3-a9d2-4c5a-aa5c-612148ba3e01 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:57.502048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7652f8-18fe-463b-bd77-1b61e16c0d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:57.502778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7652f8-18fe-463b-bd77-1b61e16c0d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:57.503070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7652f8-18fe-463b-bd77-1b61e16c0d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:57.503358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7652f8-18fe-463b-bd77-1b61e16c0d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:57.504212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7652f8-18fe-463b-bd77-1b61e16c0d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:57.505843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7652f8-18fe-463b-bd77-1b61e16c0d24 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:57.604195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bc4bd-00f1-41e4-8417-7615f010b044 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:57.610750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bc4bd-00f1-41e4-8417-7615f010b044 service swift] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:57.638465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 852/1705] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:38:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 16:38:57.886996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 854/1706] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:57.891141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bc4bd-00f1-41e4-8417-7615f010b044 service swift] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:57.920896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bc4bd-00f1-41e4-8417-7615f010b044 service swift] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:57.947645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0e95e-6323-44ea-a281-cd08e65635c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:57.959153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e95e-6323-44ea-a281-cd08e65635c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:57.959907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e95e-6323-44ea-a281-cd08e65635c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:57.960383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e95e-6323-44ea-a281-cd08e65635c0 admin admin] PATH_INFO: `/v3/projects/3c7b4da788d3474683089dcee0ccafca/users/5f15745c5af4409db9ada96d999436cd/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:58.057953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0e95e-6323-44ea-a281-cd08e65635c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7b4da788d3474683089dcee0ccafca, user_id=5f15745c5af4409db9ada96d999436cd, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:58.072630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0e95e-6323-44ea-a281-cd08e65635c0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:58.188739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 853/1707] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:38:57 2022] PUT /identity/v3/projects/3c7b4da788d3474683089dcee0ccafca/users/5f15745c5af4409db9ada96d999436cd/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:58.199419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f49ad2-f872-4d87-81b8-ee228c548ef0 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:58.199722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f49ad2-f872-4d87-81b8-ee228c548ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:58.200008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f49ad2-f872-4d87-81b8-ee228c548ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:58.272486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-54f49ad2-f872-4d87-81b8-ee228c548ef0 None None] MFA Rules not processed for user `5f15745c5af4409db9ada96d999436cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:58.273818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-54f49ad2-f872-4d87-81b8-ee228c548ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:58.446152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 855/1708] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:58.460648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0e95e-6323-44ea-a281-cd08e65635c0 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:58.469064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f49ad2-f872-4d87-81b8-ee228c548ef0 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:58.471424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-54f49ad2-f872-4d87-81b8-ee228c548ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:58.691057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f49ad2-f872-4d87-81b8-ee228c548ef0 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:58.693183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0e95e-6323-44ea-a281-cd08e65635c0 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:58.708195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:58.708830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2f52f-3dd0-471c-b46f-03709464b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:58.709157 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:58.709455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:58.709577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2f52f-3dd0-471c-b46f-03709464b362 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:58.709729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] PATH_INFO: `/v3/users/01865938642340cf82f67e4f52be16e0` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:58.709847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2f52f-3dd0-471c-b46f-03709464b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:58.710086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2f52f-3dd0-471c-b46f-03709464b362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:58.711154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2f52f-3dd0-471c-b46f-03709464b362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:58.712286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01865938642340cf82f67e4f52be16e0)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:58.717631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:58.719263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2f52f-3dd0-471c-b46f-03709464b362 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:58.872798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 854/1709] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:38:58 2022] POST /identity/v3/projects => generated 387 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:58.874192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2f52f-3dd0-471c-b46f-03709464b362 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:59.016780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01865938642340cf82f67e4f52be16e0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:59.018866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01865938642340cf82f67e4f52be16e0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:59.031472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01865938642340cf82f67e4f52be16e0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:59.033951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01865938642340cf82f67e4f52be16e0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:59.076281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2f52f-3dd0-471c-b46f-03709464b362 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:59.089980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5e3d-9211-42ea-af3d-7bfc340ac136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:59.096495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5e3d-9211-42ea-af3d-7bfc340ac136 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.096879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5e3d-9211-42ea-af3d-7bfc340ac136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.097072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5e3d-9211-42ea-af3d-7bfc340ac136 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.097944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c5e3d-9211-42ea-af3d-7bfc340ac136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:59.100125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c5e3d-9211-42ea-af3d-7bfc340ac136 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:59.132866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9ff8822a-d065-42f8-8887-ab777c3de4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01865938642340cf82f67e4f52be16e0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:38:59.182792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 856/1710] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:38:58 2022] DELETE /identity/v3/users/01865938642340cf82f67e4f52be16e0 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:38:59.186520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14274035-d2e4-4025-a9bd-95413b679694 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.186847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14274035-d2e4-4025-a9bd-95413b679694 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.193716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14274035-d2e4-4025-a9bd-95413b679694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.238460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 855/1711] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:38:58 2022] POST /identity/v3/users => generated 300 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:38:59.240246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046a61c-234d-457c-96f0-5be533940846 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.240676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046a61c-234d-457c-96f0-5be533940846 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.241399 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046a61c-234d-457c-96f0-5be533940846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.270741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-14274035-d2e4-4025-a9bd-95413b679694 None None] MFA Rules not processed for user `945ab009e1024a199a324e9c4941e8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:59.272261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-14274035-d2e4-4025-a9bd-95413b679694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:59.321691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-0046a61c-234d-457c-96f0-5be533940846 None None] MFA Rules not processed for user `0557cb45047b49818d049d5b1bb7f49f`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:59.323414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0046a61c-234d-457c-96f0-5be533940846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:59.452902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 857/1712] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:59.452902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a42ef-6aab-4889-b116-dbfde9024571 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.452902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a42ef-6aab-4889-b116-dbfde9024571 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.452902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a42ef-6aab-4889-b116-dbfde9024571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.452902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-384a42ef-6aab-4889-b116-dbfde9024571 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:38:59.452902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-384a42ef-6aab-4889-b116-dbfde9024571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:59.454243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 856/1713] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:59.456092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046a61c-234d-457c-96f0-5be533940846 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:59.458883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0046a61c-234d-457c-96f0-5be533940846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:59.570351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 858/1714] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:38:59.571874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a42ef-6aab-4889-b116-dbfde9024571 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:59.573562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-384a42ef-6aab-4889-b116-dbfde9024571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:59.638604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046a61c-234d-457c-96f0-5be533940846 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:59.651430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:59.655717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.656117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.656117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.656877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:59.667448 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:59.707613 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 857/1715] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:38:59.708938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:59.715255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:59.744949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a42ef-6aab-4889-b116-dbfde9024571 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:59.757816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:59.758861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.759223 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.759603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.775566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:59.775566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:59.784829 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c507e-9cf8-47da-9347-0e10497530f6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:59.788530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 859/1716] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:59.789585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:59.791392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:59.802631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:59.804283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.804283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.804616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.828718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:59.833167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:59.855674 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 858/1717] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:38:59.856285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:38:59.862482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:38:59.898054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad6c36-0b7d-421d-a8bc-7d21d7611b7e service nova] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:59.913866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:59.915095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.915711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.916218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] PATH_INFO: `/v3/projects/b79dca280bac4eb3b4b1786600cb95bf` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.918506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79dca280bac4eb3b4b1786600cb95bf)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:59.920693 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:38:59.947452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12f2c0-c8c6-46b8-be90-18aebb50d6ad service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:38:59.953270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84101f89-e056-49b5-952d-d7da12beb80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:38:59.953929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f89-e056-49b5-952d-d7da12beb80a service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:38:59.954052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f89-e056-49b5-952d-d7da12beb80a service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:38:59.954229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f89-e056-49b5-952d-d7da12beb80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:38:59.983642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84101f89-e056-49b5-952d-d7da12beb80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:38:59.985332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84101f89-e056-49b5-952d-d7da12beb80a service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:00.018356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 860/1718] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:00.019399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84101f89-e056-49b5-952d-d7da12beb80a service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:00.059447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84101f89-e056-49b5-952d-d7da12beb80a service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:00.081917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79dca280bac4eb3b4b1786600cb95bf', 'request_id': 'req-0def5f39-88d3-46a3-975c-61e0ac3806f0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.166714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79dca280bac4eb3b4b1786600cb95bf', 'request_id': 'req-0def5f39-88d3-46a3-975c-61e0ac3806f0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.178642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79dca280bac4eb3b4b1786600cb95bf', 'request_id': 'req-0def5f39-88d3-46a3-975c-61e0ac3806f0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.217291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] The token cache is being invalidate because project b79dca280bac4eb3b4b1786600cb95bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:00.217592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.222511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0def5f39-88d3-46a3-975c-61e0ac3806f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.229285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 859/1719] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:38:59 2022] DELETE /identity/v3/projects/b79dca280bac4eb3b4b1786600cb95bf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:00.232791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c303c9-7e90-4a8e-9214-b14dedc82148 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:00.233081 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c303c9-7e90-4a8e-9214-b14dedc82148 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:00.233518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c303c9-7e90-4a8e-9214-b14dedc82148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:00.288057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:00.289282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:00.289749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:00.290253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] PATH_INFO: `/v3/projects/7fb1f69efd83405a8c27ae8cb1e5e93b/users/311cb6d1f72747fdb70b5ac07acf65aa/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:00.308427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c2c303c9-7e90-4a8e-9214-b14dedc82148 None None] MFA Rules not processed for user `788335ddb63f4b458dd3e5b38ea3a79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:00.309745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c2c303c9-7e90-4a8e-9214-b14dedc82148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:00.321869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb1f69efd83405a8c27ae8cb1e5e93b, user_id=311cb6d1f72747fdb70b5ac07acf65aa, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:00.324968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:00.443017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 861/1720] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:00 2022] PUT /identity/v3/projects/7fb1f69efd83405a8c27ae8cb1e5e93b/users/311cb6d1f72747fdb70b5ac07acf65aa/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:00.448678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:00.448678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:00.465022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 860/1721] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:00.487163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121950-6bab-4092-8656-db330eb02cb3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:00.491247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121950-6bab-4092-8656-db330eb02cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:00.491543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121950-6bab-4092-8656-db330eb02cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:00.554822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-28121950-6bab-4092-8656-db330eb02cb3 None None] MFA Rules not processed for user `ebf1f55dbef94868aaac6d39ed70690b`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:00.557420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-28121950-6bab-4092-8656-db330eb02cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:00.596715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de414022-3ca5-44dc-80cd-2cf9323f8054 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:00.616472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:00.618560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:00.623081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:00.623081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] PATH_INFO: `/v3/users/67089f2c0df54c0fa36bbeecce2e96ff` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:00.624335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67089f2c0df54c0fa36bbeecce2e96ff)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:00.630549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:00.655994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 861/1722] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Apr 28 16:39:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:00.658185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28121950-6bab-4092-8656-db330eb02cb3 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:00.668758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-28121950-6bab-4092-8656-db330eb02cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:00.722402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28121950-6bab-4092-8656-db330eb02cb3 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:00.727161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abd722-9598-4863-8fc3-7b5fca1f4bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:00.728140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd722-9598-4863-8fc3-7b5fca1f4bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:00.728581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd722-9598-4863-8fc3-7b5fca1f4bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:00.729006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abd722-9598-4863-8fc3-7b5fca1f4bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:00.729900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd722-9598-4863-8fc3-7b5fca1f4bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:00.732091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abd722-9598-4863-8fc3-7b5fca1f4bb0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:00.751313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 862/1723] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:00.752120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4b00f-e6fc-43b9-990b-6038ce204c6f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:00.752929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4b00f-e6fc-43b9-990b-6038ce204c6f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:00.753473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4b00f-e6fc-43b9-990b-6038ce204c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:00.796816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c7a4b00f-e6fc-43b9-990b-6038ce204c6f None None] MFA Rules not processed for user `788335ddb63f4b458dd3e5b38ea3a79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:00.805077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c7a4b00f-e6fc-43b9-990b-6038ce204c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:00.863893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67089f2c0df54c0fa36bbeecce2e96ff'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.865411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67089f2c0df54c0fa36bbeecce2e96ff'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.882613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67089f2c0df54c0fa36bbeecce2e96ff'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.883599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67089f2c0df54c0fa36bbeecce2e96ff'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.955537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 863/1724] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:00.956814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4b00f-e6fc-43b9-990b-6038ce204c6f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:00.961864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c7a4b00f-e6fc-43b9-990b-6038ce204c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:00.979642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4b00f-e6fc-43b9-990b-6038ce204c6f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:00.984059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67089f2c0df54c0fa36bbeecce2e96ff'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:00.995597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d952f-b139-4284-b80f-51412d9658c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:01.000132 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d952f-b139-4284-b80f-51412d9658c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:01.000835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d952f-b139-4284-b80f-51412d9658c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:01.002524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d952f-b139-4284-b80f-51412d9658c0 admin admin] PATH_INFO: `/v3/projects/7fb1f69efd83405a8c27ae8cb1e5e93b/users/311cb6d1f72747fdb70b5ac07acf65aa/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:01.007678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d952f-b139-4284-b80f-51412d9658c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb1f69efd83405a8c27ae8cb1e5e93b, user_id=311cb6d1f72747fdb70b5ac07acf65aa, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:01.012824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 862/1725] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:00 2022] DELETE /identity/v3/users/67089f2c0df54c0fa36bbeecce2e96ff => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:01.014659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d952f-b139-4284-b80f-51412d9658c0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:01.015670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:01.019364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:01.063266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 864/1726] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:00 2022] PUT /identity/v3/projects/7fb1f69efd83405a8c27ae8cb1e5e93b/users/311cb6d1f72747fdb70b5ac07acf65aa/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:01.075817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c23b-da1d-4a07-8aaf-b3af4da886a3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:01.076439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c23b-da1d-4a07-8aaf-b3af4da886a3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:01.077219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c23b-da1d-4a07-8aaf-b3af4da886a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:01.144511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-fa57c23b-da1d-4a07-8aaf-b3af4da886a3 None None] MFA Rules not processed for user `311cb6d1f72747fdb70b5ac07acf65aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:01.149101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fa57c23b-da1d-4a07-8aaf-b3af4da886a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:01.247430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6b930-c08d-4be8-b1c4-4cd60cbf3f20 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:01.414870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 865/1727] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:01.423501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57c23b-da1d-4a07-8aaf-b3af4da886a3 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:01.428513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fa57c23b-da1d-4a07-8aaf-b3af4da886a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:01.460369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:01.461105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:01.473569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:01.475400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:01.488746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:01.624115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57c23b-da1d-4a07-8aaf-b3af4da886a3 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:01.631152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:01.632139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:01.632800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:01.633226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:01.635456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:01.691993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:01.701381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:01.708775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:01.713589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:01.723611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 863/1728] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:01.724490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:01.726212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:01.743506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 866/1729] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:01.747927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:01.753726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:01.895776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de87d06-1c2d-428f-a483-55bee53d66ca service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:01.915545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:01.916249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:01.916541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:01.916824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:01.943592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:01.945177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:01.965380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292e1e0-7e80-40b3-b84d-60d3358ce994 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:01.982376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:01.983590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:01.983828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:01.984152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] PATH_INFO: `/v3/projects/7a465fa86d1140f0adfc06a6827bcb36` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:01.987344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a465fa86d1140f0adfc06a6827bcb36)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:01.991559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:01.995135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 864/1730] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:02.126789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:02.128551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:02.198714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deede223-7f1e-4fc0-b423-8de7a49b74d2 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:02.247297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a465fa86d1140f0adfc06a6827bcb36', 'request_id': 'req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.316467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a465fa86d1140f0adfc06a6827bcb36', 'request_id': 'req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.323066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a465fa86d1140f0adfc06a6827bcb36', 'request_id': 'req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.364061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] The token cache is being invalidate because project 7a465fa86d1140f0adfc06a6827bcb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:02.364061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.368222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.372976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 867/1731] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:01 2022] DELETE /identity/v3/projects/7a465fa86d1140f0adfc06a6827bcb36 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:02.380408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:02.381839 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:02.520023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:02.520919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:02.521262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:02.521483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] PATH_INFO: `/v3/projects/805c4de1dd254d009436e56c58d9cac2` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:02.523269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=805c4de1dd254d009436e56c58d9cac2)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:02.533210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:02.603118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743eafd-e7c9-4e2d-b3a4-08ae7926d173 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:02.611470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:02.611470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:02.611470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:02.611470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] PATH_INFO: `/v3/users/5f15745c5af4409db9ada96d999436cd` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:02.619287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f15745c5af4409db9ada96d999436cd)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:02.623913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:02.763142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805c4de1dd254d009436e56c58d9cac2', 'request_id': 'req-b20dd182-b012-4be9-9c98-5eda352eda5b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.849606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805c4de1dd254d009436e56c58d9cac2', 'request_id': 'req-b20dd182-b012-4be9-9c98-5eda352eda5b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.863874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805c4de1dd254d009436e56c58d9cac2', 'request_id': 'req-b20dd182-b012-4be9-9c98-5eda352eda5b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.900020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f15745c5af4409db9ada96d999436cd'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.911261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] The token cache is being invalidate because project 805c4de1dd254d009436e56c58d9cac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:02.915114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.924445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b20dd182-b012-4be9-9c98-5eda352eda5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.931281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 865/1732] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:02 2022] DELETE /identity/v3/projects/805c4de1dd254d009436e56c58d9cac2 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:02.932705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f15745c5af4409db9ada96d999436cd'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.933962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f15745c5af4409db9ada96d999436cd'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.936845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f15745c5af4409db9ada96d999436cd'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:02.937130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3d4c-eed0-47ff-8bca-f32eea259df2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:02.937453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3d4c-eed0-47ff-8bca-f32eea259df2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:02.937744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a3d4c-eed0-47ff-8bca-f32eea259df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:02.985346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ef4a3d4c-eed0-47ff-8bca-f32eea259df2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:02.991714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ef4a3d4c-eed0-47ff-8bca-f32eea259df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:03.001596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f24b660-d417-46e2-9cc3-0c46473254da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f15745c5af4409db9ada96d999436cd'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:03.051456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 868/1733] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:02 2022] DELETE /identity/v3/users/5f15745c5af4409db9ada96d999436cd => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:03.053217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9370-efc3-412c-8538-3c9131fb0235 None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.060273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9370-efc3-412c-8538-3c9131fb0235 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.060797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9370-efc3-412c-8538-3c9131fb0235 None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.064057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 869/1734] 10.222.0.43 () {54 vars in 912 bytes} [Thu Apr 28 16:39:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:39:03.069020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5f4e-65ae-4c6a-b646-d4e9794c89e3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.072956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5f4e-65ae-4c6a-b646-d4e9794c89e3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.072956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5f4e-65ae-4c6a-b646-d4e9794c89e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.128491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 866/1735] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:03.130096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61a64-1a50-4c4c-a859-a27c9148f44f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.130389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61a64-1a50-4c4c-a859-a27c9148f44f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.130739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61a64-1a50-4c4c-a859-a27c9148f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.142846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a2cf5f4e-65ae-4c6a-b646-d4e9794c89e3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:03.154492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a2cf5f4e-65ae-4c6a-b646-d4e9794c89e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:03.174522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f3a61a64-1a50-4c4c-a859-a27c9148f44f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:03.184834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f3a61a64-1a50-4c4c-a859-a27c9148f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:03.295872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 870/1736] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:03.299927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409c33-c787-441d-bf9e-0d059101d835 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.300619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409c33-c787-441d-bf9e-0d059101d835 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.301414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6409c33-c787-441d-bf9e-0d059101d835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.337285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d6409c33-c787-441d-bf9e-0d059101d835 None None] MFA Rules not processed for user `ebf1f55dbef94868aaac6d39ed70690b`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:03.341403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d6409c33-c787-441d-bf9e-0d059101d835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:03.439589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 871/1737] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:03.441016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8edfe-f320-4f2d-a2f7-e178c2bbc64c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.441320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8edfe-f320-4f2d-a2f7-e178c2bbc64c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.441596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8edfe-f320-4f2d-a2f7-e178c2bbc64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.473097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 867/1738] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:03.474752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfdf29-6265-41e2-8329-643fd465fc32 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.475207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfdf29-6265-41e2-8329-643fd465fc32 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.475724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfdf29-6265-41e2-8329-643fd465fc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.478504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c2b8edfe-f320-4f2d-a2f7-e178c2bbc64c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:03.480480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c2b8edfe-f320-4f2d-a2f7-e178c2bbc64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:03.498071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 872/1739] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:03.499931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8edfe-f320-4f2d-a2f7-e178c2bbc64c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:03.503203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c2b8edfe-f320-4f2d-a2f7-e178c2bbc64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:03.523951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-0cbfdf29-6265-41e2-8329-643fd465fc32 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:03.525483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0cbfdf29-6265-41e2-8329-643fd465fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:03.532374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8edfe-f320-4f2d-a2f7-e178c2bbc64c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:03.545247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13775df5-a039-4630-a756-9a7d268e569a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:03.546119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13775df5-a039-4630-a756-9a7d268e569a service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.550279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13775df5-a039-4630-a756-9a7d268e569a service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.550279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13775df5-a039-4630-a756-9a7d268e569a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.551879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 868/1740] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:03.553052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfdf29-6265-41e2-8329-643fd465fc32 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:03.560631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13775df5-a039-4630-a756-9a7d268e569a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:03.562269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13775df5-a039-4630-a756-9a7d268e569a service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:03.575609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfdf29-6265-41e2-8329-643fd465fc32 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:03.599830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 873/1741] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:03.600672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:03.600899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13775df5-a039-4630-a756-9a7d268e569a service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:03.601696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.602146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.602604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.603497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:03.603959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:03.605738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:03.614916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13775df5-a039-4630-a756-9a7d268e569a service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:03.620269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855c6f-93ec-47d7-89fb-340a23693ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:03.620937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855c6f-93ec-47d7-89fb-340a23693ceb service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.621223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855c6f-93ec-47d7-89fb-340a23693ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.623235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855c6f-93ec-47d7-89fb-340a23693ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.639758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94855c6f-93ec-47d7-89fb-340a23693ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:03.644307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94855c6f-93ec-47d7-89fb-340a23693ceb service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:03.646069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 869/1742] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:03.647168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:03.664280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 874/1743] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:03.665189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855c6f-93ec-47d7-89fb-340a23693ceb service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:03.670265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed23593-6372-458a-a0aa-9f3617ad8780 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:03.683240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855c6f-93ec-47d7-89fb-340a23693ceb service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:03.686301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:03.687283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.687792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.688484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.689951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:03.690406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:03.691648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777884-0fcf-407c-969e-54102b4363c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:03.692520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777884-0fcf-407c-969e-54102b4363c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.692813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777884-0fcf-407c-969e-54102b4363c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.694131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7777884-0fcf-407c-969e-54102b4363c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.694242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:03.694401 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777884-0fcf-407c-969e-54102b4363c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:03.698853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7777884-0fcf-407c-969e-54102b4363c4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:03.729597 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 870/1744] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:03.730264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:03.755358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fc801-3321-484a-89f8-f80817aaab70 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:03.781807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932175f-c776-442e-aff2-734415dec509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:03.782505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932175f-c776-442e-aff2-734415dec509 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:03.783152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932175f-c776-442e-aff2-734415dec509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:03.783426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932175f-c776-442e-aff2-734415dec509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:03.785072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932175f-c776-442e-aff2-734415dec509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:03.786288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932175f-c776-442e-aff2-734415dec509 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:03.888405 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 875/1745] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:03.889883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777884-0fcf-407c-969e-54102b4363c4 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:03.942827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 871/1746] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:03.944606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932175f-c776-442e-aff2-734415dec509 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:04.068418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7777884-0fcf-407c-969e-54102b4363c4 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:04.123107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932175f-c776-442e-aff2-734415dec509 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:04.140960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd77c-ba0d-4085-a16c-3ce732df9467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:04.141806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd77c-ba0d-4085-a16c-3ce732df9467 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.142130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd77c-ba0d-4085-a16c-3ce732df9467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.142425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd77c-ba0d-4085-a16c-3ce732df9467 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.143235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd77c-ba0d-4085-a16c-3ce732df9467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:04.145702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd77c-ba0d-4085-a16c-3ce732df9467 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:04.210520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449010d-48f9-4ef1-9340-ee50d3a1988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:04.211448 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449010d-48f9-4ef1-9340-ee50d3a1988d admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.211843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449010d-48f9-4ef1-9340-ee50d3a1988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.212183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449010d-48f9-4ef1-9340-ee50d3a1988d admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.212954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449010d-48f9-4ef1-9340-ee50d3a1988d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:04.215190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449010d-48f9-4ef1-9340-ee50d3a1988d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:04.262313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 872/1747] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/users => generated 283 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:04.316100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd77c-ba0d-4085-a16c-3ce732df9467 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:04.318261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 876/1748] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:03 2022] POST /identity/v3/users => generated 285 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:04.328465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449010d-48f9-4ef1-9340-ee50d3a1988d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:04.351661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449010d-48f9-4ef1-9340-ee50d3a1988d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:04.351903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd77c-ba0d-4085-a16c-3ce732df9467 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:04.357892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046918b7-7a74-46b1-b5ce-c6277a88c8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:04.359007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046918b7-7a74-46b1-b5ce-c6277a88c8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.359726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046918b7-7a74-46b1-b5ce-c6277a88c8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.360151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046918b7-7a74-46b1-b5ce-c6277a88c8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.361473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046918b7-7a74-46b1-b5ce-c6277a88c8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:04.364593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046918b7-7a74-46b1-b5ce-c6277a88c8a9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:04.380010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cf21-d303-494f-88ed-f6a13d500a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:04.381021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cf21-d303-494f-88ed-f6a13d500a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.381437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cf21-d303-494f-88ed-f6a13d500a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.381827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cf21-d303-494f-88ed-f6a13d500a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.382799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379cf21-d303-494f-88ed-f6a13d500a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:04.385917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379cf21-d303-494f-88ed-f6a13d500a98 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:04.420394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 877/1749] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:04.420702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 873/1750] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:04.427478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046918b7-7a74-46b1-b5ce-c6277a88c8a9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:04.429467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cf21-d303-494f-88ed-f6a13d500a98 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:04.453091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379cf21-d303-494f-88ed-f6a13d500a98 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:04.453775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046918b7-7a74-46b1-b5ce-c6277a88c8a9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:04.468429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb129542-7e02-4fd6-9b5a-1b3f538047b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:04.469819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129542-7e02-4fd6-9b5a-1b3f538047b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.470777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129542-7e02-4fd6-9b5a-1b3f538047b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.471570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2c0e-d76c-47d5-b596-98668694658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:04.475599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2c0e-d76c-47d5-b596-98668694658a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.475719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb129542-7e02-4fd6-9b5a-1b3f538047b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.475793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2c0e-d76c-47d5-b596-98668694658a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.475871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb129542-7e02-4fd6-9b5a-1b3f538047b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:04.475956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2c0e-d76c-47d5-b596-98668694658a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.476775 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd2c0e-d76c-47d5-b596-98668694658a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:04.478562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd2c0e-d76c-47d5-b596-98668694658a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:04.479246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb129542-7e02-4fd6-9b5a-1b3f538047b7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:04.525256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 874/1751] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:04.527071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb129542-7e02-4fd6-9b5a-1b3f538047b7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:04.531922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 878/1752] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:04.537942 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2c0e-d76c-47d5-b596-98668694658a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:04.559423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2c0e-d76c-47d5-b596-98668694658a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:04.559896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb129542-7e02-4fd6-9b5a-1b3f538047b7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:04.579145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd495f42-9dee-465d-adb1-6f8fd3b4915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:04.580540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bae878-1556-40e7-8033-7f3da5a5936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:04.581747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd495f42-9dee-465d-adb1-6f8fd3b4915d admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.582999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae878-1556-40e7-8033-7f3da5a5936a admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.583602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd495f42-9dee-465d-adb1-6f8fd3b4915d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.584064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd495f42-9dee-465d-adb1-6f8fd3b4915d admin admin] PATH_INFO: `/v3/projects/75c9da493b53402fafaad643d8d5ce25/users/093bfda8547844eeada205b4e3cb0a7c/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.585858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae878-1556-40e7-8033-7f3da5a5936a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.585858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bae878-1556-40e7-8033-7f3da5a5936a admin admin] PATH_INFO: `/v3/projects/27aed956c9e041b49d334fd01a51f02c/users/e90195309d8c4730bcf4ad69aaf44ac5/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.623118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd495f42-9dee-465d-adb1-6f8fd3b4915d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c9da493b53402fafaad643d8d5ce25, user_id=093bfda8547844eeada205b4e3cb0a7c, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:04.626017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bae878-1556-40e7-8033-7f3da5a5936a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27aed956c9e041b49d334fd01a51f02c, user_id=e90195309d8c4730bcf4ad69aaf44ac5, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:04.629402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bae878-1556-40e7-8033-7f3da5a5936a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:04.632200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd495f42-9dee-465d-adb1-6f8fd3b4915d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:04.752781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 879/1753] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:04 2022] PUT /identity/v3/projects/75c9da493b53402fafaad643d8d5ce25/users/093bfda8547844eeada205b4e3cb0a7c/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:04.764114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91054755-920f-45aa-be75-fe9abec2eabe None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.764509 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91054755-920f-45aa-be75-fe9abec2eabe None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.765066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91054755-920f-45aa-be75-fe9abec2eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.781401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 875/1754] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:04 2022] PUT /identity/v3/projects/27aed956c9e041b49d334fd01a51f02c/users/e90195309d8c4730bcf4ad69aaf44ac5/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:04.796679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79ef7-e8dd-40c2-b7e6-86c368417f21 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:04.797445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79ef7-e8dd-40c2-b7e6-86c368417f21 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:04.797445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd79ef7-e8dd-40c2-b7e6-86c368417f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:04.878878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-91054755-920f-45aa-be75-fe9abec2eabe None None] MFA Rules not processed for user `093bfda8547844eeada205b4e3cb0a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:04.880224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-91054755-920f-45aa-be75-fe9abec2eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:04.955755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5bd79ef7-e8dd-40c2-b7e6-86c368417f21 None None] MFA Rules not processed for user `e90195309d8c4730bcf4ad69aaf44ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:04.957097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5bd79ef7-e8dd-40c2-b7e6-86c368417f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:05.225154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 880/1755] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:05.229429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91054755-920f-45aa-be75-fe9abec2eabe None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:05.306624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 876/1756] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:05.307899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd79ef7-e8dd-40c2-b7e6-86c368417f21 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:05.508151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91054755-920f-45aa-be75-fe9abec2eabe None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:05.534411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ed095-ae4e-4f95-b864-0e8384727a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:05.535199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed095-ae4e-4f95-b864-0e8384727a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:05.535486 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed095-ae4e-4f95-b864-0e8384727a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:05.535766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ed095-ae4e-4f95-b864-0e8384727a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:05.536492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ed095-ae4e-4f95-b864-0e8384727a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:05.538480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ed095-ae4e-4f95-b864-0e8384727a1e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:05.553054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd79ef7-e8dd-40c2-b7e6-86c368417f21 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:05.577647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1ba3-1769-4d00-b222-99bcb6d3cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:05.581289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1ba3-1769-4d00-b222-99bcb6d3cf93 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:05.582047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1ba3-1769-4d00-b222-99bcb6d3cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:05.582286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1ba3-1769-4d00-b222-99bcb6d3cf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:05.591831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1ba3-1769-4d00-b222-99bcb6d3cf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:05.597690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1ba3-1769-4d00-b222-99bcb6d3cf93 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:05.690935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 881/1757] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:05 2022] POST /identity/v3/projects => generated 369 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:05.694411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ed095-ae4e-4f95-b864-0e8384727a1e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:05.816715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 877/1758] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:05 2022] POST /identity/v3/projects => generated 365 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:05.816715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1ba3-1769-4d00-b222-99bcb6d3cf93 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:05.904172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ed095-ae4e-4f95-b864-0e8384727a1e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:06.110182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bf1af-39af-4cca-950c-efa179dff951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:06.118725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf1af-39af-4cca-950c-efa179dff951 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.120016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf1af-39af-4cca-950c-efa179dff951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:06.121082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bf1af-39af-4cca-950c-efa179dff951 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:06.123596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bf1af-39af-4cca-950c-efa179dff951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:06.128379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39bf1af-39af-4cca-950c-efa179dff951 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:06.151263 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1ba3-1769-4d00-b222-99bcb6d3cf93 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:06.160557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f1795-d432-4dd3-afa0-c1cca3f17c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:06.161796 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1795-d432-4dd3-afa0-c1cca3f17c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.162241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1795-d432-4dd3-afa0-c1cca3f17c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:06.162699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f1795-d432-4dd3-afa0-c1cca3f17c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:06.163554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1795-d432-4dd3-afa0-c1cca3f17c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:06.165844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f1795-d432-4dd3-afa0-c1cca3f17c0c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:06.262073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 882/1759] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:05 2022] POST /identity/v3/users => generated 291 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:06.266032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bf1af-39af-4cca-950c-efa179dff951 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:06.293351 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bf1af-39af-4cca-950c-efa179dff951 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:06.309878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041d0b-d0ce-4ef1-a462-c94a76876b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:06.311338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 878/1760] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:05 2022] POST /identity/v3/users => generated 289 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:06.311725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041d0b-d0ce-4ef1-a462-c94a76876b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.312962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b16a5-0223-4b19-8a40-51c38d2913e4 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.313252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b16a5-0223-4b19-8a40-51c38d2913e4 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:06.315572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b16a5-0223-4b19-8a40-51c38d2913e4 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:06.315925 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041d0b-d0ce-4ef1-a462-c94a76876b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:06.316687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54041d0b-d0ce-4ef1-a462-c94a76876b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:06.318856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041d0b-d0ce-4ef1-a462-c94a76876b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:06.320220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 879/1761] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:39:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:39:06.321159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b16a5-0223-4b19-8a40-51c38d2913e4 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:06.324133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54041d0b-d0ce-4ef1-a462-c94a76876b94 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:06.363632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 883/1762] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:06.366201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041d0b-d0ce-4ef1-a462-c94a76876b94 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:06.372006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b16a5-0223-4b19-8a40-51c38d2913e4 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:06.390246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ffb3d-e205-4874-8388-3cb8034bcb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:06.390986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffb3d-e205-4874-8388-3cb8034bcb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.391281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffb3d-e205-4874-8388-3cb8034bcb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:06.391642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ffb3d-e205-4874-8388-3cb8034bcb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:06.414056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ffb3d-e205-4874-8388-3cb8034bcb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:06.424580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ffb3d-e205-4874-8388-3cb8034bcb45 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:06.437055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54041d0b-d0ce-4ef1-a462-c94a76876b94 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:06.450294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c969-0b6f-43d9-b5c3-e6b33e231c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:06.453447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c969-0b6f-43d9-b5c3-e6b33e231c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.454092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c969-0b6f-43d9-b5c3-e6b33e231c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:06.455372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c969-0b6f-43d9-b5c3-e6b33e231c95 admin admin] PATH_INFO: `/v3/projects/cf5fdb818d424f95aa8028d7236d2ba4/users/982191e367de4876b9b4f0d02773752a/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:06.469362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 880/1763] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:06.470997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727860da-1a92-499d-93f4-6bb7266dfe43 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.471295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727860da-1a92-499d-93f4-6bb7266dfe43 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:06.471586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727860da-1a92-499d-93f4-6bb7266dfe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:06.520561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7c969-0b6f-43d9-b5c3-e6b33e231c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5fdb818d424f95aa8028d7236d2ba4, user_id=982191e367de4876b9b4f0d02773752a, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:06.524957 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7c969-0b6f-43d9-b5c3-e6b33e231c95 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:06.535022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-727860da-1a92-499d-93f4-6bb7266dfe43 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:06.536406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-727860da-1a92-499d-93f4-6bb7266dfe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:06.645726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 884/1764] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:06 2022] PUT /identity/v3/projects/cf5fdb818d424f95aa8028d7236d2ba4/users/982191e367de4876b9b4f0d02773752a/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:06.646960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c969-0b6f-43d9-b5c3-e6b33e231c95 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:06.881538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c969-0b6f-43d9-b5c3-e6b33e231c95 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:06.900008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb5cc0-cc04-4d7b-8e5a-575b9d232719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:06.903913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5cc0-cc04-4d7b-8e5a-575b9d232719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.909220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5cc0-cc04-4d7b-8e5a-575b9d232719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:06.909220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb5cc0-cc04-4d7b-8e5a-575b9d232719 admin admin] PATH_INFO: `/v3/projects/fd8f5a3416ac45b190a12929a6f1e76a/users/73b0016e2e124444a1db496b0324a51a/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:06.951017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 881/1765] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:39:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:06.952684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727860da-1a92-499d-93f4-6bb7266dfe43 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:06.973376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5cc0-cc04-4d7b-8e5a-575b9d232719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8f5a3416ac45b190a12929a6f1e76a, user_id=73b0016e2e124444a1db496b0324a51a, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:06.985056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb5cc0-cc04-4d7b-8e5a-575b9d232719 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:06.987966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727860da-1a92-499d-93f4-6bb7266dfe43 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:06.997884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:06.998909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:06.999290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:07.001121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:07.001121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:07.001977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:07.070068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 885/1766] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:06 2022] PUT /identity/v3/projects/fd8f5a3416ac45b190a12929a6f1e76a/users/73b0016e2e124444a1db496b0324a51a/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:07.072156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef44e2b-7d91-420e-b922-54a3b2af2e25 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:07.072156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef44e2b-7d91-420e-b922-54a3b2af2e25 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:07.072519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef44e2b-7d91-420e-b922-54a3b2af2e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:07.073356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 882/1767] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:07.075274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:07.095772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:07.134834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4ef44e2b-7d91-420e-b922-54a3b2af2e25 None None] MFA Rules not processed for user `788335ddb63f4b458dd3e5b38ea3a79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:07.136056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4ef44e2b-7d91-420e-b922-54a3b2af2e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:07.336257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc8114-e332-4fb8-9644-8523c566ae7a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:07.352133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 886/1768] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:07.353562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef44e2b-7d91-420e-b922-54a3b2af2e25 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:07.530449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf999ec1-1450-41e1-90e3-9d676fad9c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:07.531252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf999ec1-1450-41e1-90e3-9d676fad9c34 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:07.531539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf999ec1-1450-41e1-90e3-9d676fad9c34 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:07.531823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf999ec1-1450-41e1-90e3-9d676fad9c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:07.567799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf999ec1-1450-41e1-90e3-9d676fad9c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:07.570299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf999ec1-1450-41e1-90e3-9d676fad9c34 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:07.586051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef44e2b-7d91-420e-b922-54a3b2af2e25 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:07.601494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db4f5d-a594-4a89-848b-7144c5e29da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:07.603610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4f5d-a594-4a89-848b-7144c5e29da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:07.603751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 883/1769] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:07.604815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf999ec1-1450-41e1-90e3-9d676fad9c34 service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:07.606065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4f5d-a594-4a89-848b-7144c5e29da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:07.606431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4f5d-a594-4a89-848b-7144c5e29da5 admin admin] PATH_INFO: `/v3/projects/cf5fdb818d424f95aa8028d7236d2ba4/users/982191e367de4876b9b4f0d02773752a/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:07.614710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db4f5d-a594-4a89-848b-7144c5e29da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5fdb818d424f95aa8028d7236d2ba4, user_id=982191e367de4876b9b4f0d02773752a, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:07.622917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db4f5d-a594-4a89-848b-7144c5e29da5 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:07.638371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf999ec1-1450-41e1-90e3-9d676fad9c34 service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:07.652318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf42a-88c2-4ef5-bac3-b4a5bf2b3c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:07.653748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf42a-88c2-4ef5-bac3-b4a5bf2b3c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:07.653748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf42a-88c2-4ef5-bac3-b4a5bf2b3c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:07.653748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf42a-88c2-4ef5-bac3-b4a5bf2b3c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:07.654469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf42a-88c2-4ef5-bac3-b4a5bf2b3c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:07.656219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf42a-88c2-4ef5-bac3-b4a5bf2b3c11 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:07.671853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 887/1770] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:07 2022] PUT /identity/v3/projects/cf5fdb818d424f95aa8028d7236d2ba4/users/982191e367de4876b9b4f0d02773752a/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:07.682926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7b1a6-6326-4f26-8ad4-d3ad1591448b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:07.684217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7b1a6-6326-4f26-8ad4-d3ad1591448b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:07.691157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7b1a6-6326-4f26-8ad4-d3ad1591448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:07.708211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 884/1771] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:07.714491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf42a-88c2-4ef5-bac3-b4a5bf2b3c11 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:07.729740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf42a-88c2-4ef5-bac3-b4a5bf2b3c11 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:07.765351 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a3c7b1a6-6326-4f26-8ad4-d3ad1591448b None None] MFA Rules not processed for user `982191e367de4876b9b4f0d02773752a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:07.767429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a3c7b1a6-6326-4f26-8ad4-d3ad1591448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:07.884593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832f818-d54b-4b45-b6c9-85a449c0969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:07.885561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832f818-d54b-4b45-b6c9-85a449c0969d admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:07.885955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832f818-d54b-4b45-b6c9-85a449c0969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:07.891192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832f818-d54b-4b45-b6c9-85a449c0969d admin admin] PATH_INFO: `/v3/projects/fd8f5a3416ac45b190a12929a6f1e76a/users/73b0016e2e124444a1db496b0324a51a/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:07.901279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832f818-d54b-4b45-b6c9-85a449c0969d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8f5a3416ac45b190a12929a6f1e76a, user_id=73b0016e2e124444a1db496b0324a51a, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:07.904752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832f818-d54b-4b45-b6c9-85a449c0969d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:07.944891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 885/1772] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:07 2022] PUT /identity/v3/projects/fd8f5a3416ac45b190a12929a6f1e76a/users/73b0016e2e124444a1db496b0324a51a/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:07.957804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c5546-1c8e-4987-840f-257333bc9c44 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:07.958457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c5546-1c8e-4987-840f-257333bc9c44 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:07.958457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c5546-1c8e-4987-840f-257333bc9c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:08.042766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-760c5546-1c8e-4987-840f-257333bc9c44 None None] MFA Rules not processed for user `73b0016e2e124444a1db496b0324a51a`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:08.044953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-760c5546-1c8e-4987-840f-257333bc9c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:08.061685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 888/1773] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:08.063598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7b1a6-6326-4f26-8ad4-d3ad1591448b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:08.065946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a3c7b1a6-6326-4f26-8ad4-d3ad1591448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:08.224194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 886/1774] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:08.235139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7b1a6-6326-4f26-8ad4-d3ad1591448b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:08.236504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c5546-1c8e-4987-840f-257333bc9c44 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:08.238918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-760c5546-1c8e-4987-840f-257333bc9c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:08.367440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c5546-1c8e-4987-840f-257333bc9c44 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:08.371996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:08.373187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:08.373693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:08.374090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:08.397344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe46b9-2815-490e-9516-010f282a8af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:08.398034 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe46b9-2815-490e-9516-010f282a8af9 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:08.398489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe46b9-2815-490e-9516-010f282a8af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:08.399064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe46b9-2815-490e-9516-010f282a8af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:08.415839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:08.421482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:08.457642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 887/1775] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:08.461151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:08.464789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:08.672977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe46b9-2815-490e-9516-010f282a8af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:08.675234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe46b9-2815-490e-9516-010f282a8af9 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:08.704425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 889/1776] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:08.706497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0207ea-a17f-48ef-a882-49bc256ae35a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:08.706497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0207ea-a17f-48ef-a882-49bc256ae35a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:08.706744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0207ea-a17f-48ef-a882-49bc256ae35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:08.713374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53226e8-a385-470c-a77a-a0caab7dc213 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:08.728034 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:08.731032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:08.731032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:08.731032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] PATH_INFO: `/v3/projects/3c7b4da788d3474683089dcee0ccafca` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:08.731675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7b4da788d3474683089dcee0ccafca)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:08.734312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:08.777956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-0f0207ea-a17f-48ef-a882-49bc256ae35a None None] MFA Rules not processed for user `945ab009e1024a199a324e9c4941e8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:08.777956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0f0207ea-a17f-48ef-a882-49bc256ae35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:08.967573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7b4da788d3474683089dcee0ccafca', 'request_id': 'req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:08.979877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 890/1777] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:08.980851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0207ea-a17f-48ef-a882-49bc256ae35a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:09.000267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0207ea-a17f-48ef-a882-49bc256ae35a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:09.080957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7b4da788d3474683089dcee0ccafca', 'request_id': 'req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:09.089138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7b4da788d3474683089dcee0ccafca', 'request_id': 'req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:09.123108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228330-3c69-4efe-b52e-74dc572c31ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:09.125508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228330-3c69-4efe-b52e-74dc572c31ff service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:09.126082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228330-3c69-4efe-b52e-74dc572c31ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:09.126557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0228330-3c69-4efe-b52e-74dc572c31ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:09.130042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] The token cache is being invalidate because project 3c7b4da788d3474683089dcee0ccafca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:09.130351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:09.132055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2f786e2a-9e11-4c4d-80f6-f5da1bb3a9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:09.139649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 888/1778] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:08 2022] DELETE /identity/v3/projects/3c7b4da788d3474683089dcee0ccafca => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:09.142220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329ed76-9be2-4f7e-9b48-e0227eb3a713 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:09.142588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329ed76-9be2-4f7e-9b48-e0227eb3a713 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:09.142877 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329ed76-9be2-4f7e-9b48-e0227eb3a713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:09.195331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-8329ed76-9be2-4f7e-9b48-e0227eb3a713 None None] MFA Rules not processed for user `0557cb45047b49818d049d5b1bb7f49f`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:09.212125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8329ed76-9be2-4f7e-9b48-e0227eb3a713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:09.425792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0228330-3c69-4efe-b52e-74dc572c31ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:09.431664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0228330-3c69-4efe-b52e-74dc572c31ff service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:09.483379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 891/1779] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:09.497611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228330-3c69-4efe-b52e-74dc572c31ff service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:09.512435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 889/1780] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:09.513413 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329ed76-9be2-4f7e-9b48-e0227eb3a713 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:09.518870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8329ed76-9be2-4f7e-9b48-e0227eb3a713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:09.540847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0228330-3c69-4efe-b52e-74dc572c31ff service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:09.569962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:09.578396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:09.578762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:09.580883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:09.585687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:09.829268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329ed76-9be2-4f7e-9b48-e0227eb3a713 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:09.836707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:09.838834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:09.877368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:09.881195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:09.882274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:09.883419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] PATH_INFO: `/v3/users/311cb6d1f72747fdb70b5ac07acf65aa` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:09.884495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 892/1781] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:09.886040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=311cb6d1f72747fdb70b5ac07acf65aa)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:09.889379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:10.205164 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311cb6d1f72747fdb70b5ac07acf65aa'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:10.208307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311cb6d1f72747fdb70b5ac07acf65aa'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:10.238891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311cb6d1f72747fdb70b5ac07acf65aa'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:10.238891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311cb6d1f72747fdb70b5ac07acf65aa'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:10.349959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67e6a3b8-f0f6-49d6-86e1-0d1e7c5107c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311cb6d1f72747fdb70b5ac07acf65aa'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:10.374256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 890/1782] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:09 2022] DELETE /identity/v3/users/311cb6d1f72747fdb70b5ac07acf65aa => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:12.330317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:12.347013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298f8d1-6bc9-4f76-8241-caa3c4b9999d service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:12.595985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:12.597376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:12.597757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:12.598383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] PATH_INFO: `/v3/projects/7fb1f69efd83405a8c27ae8cb1e5e93b` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:12.600410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb1f69efd83405a8c27ae8cb1e5e93b)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:12.602836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:12.804566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb1f69efd83405a8c27ae8cb1e5e93b', 'request_id': 'req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:12.894217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb1f69efd83405a8c27ae8cb1e5e93b', 'request_id': 'req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:12.905904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb1f69efd83405a8c27ae8cb1e5e93b', 'request_id': 'req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:12.944199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] The token cache is being invalidate because project 7fb1f69efd83405a8c27ae8cb1e5e93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:12.944478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:12.945203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d5b151a9-fbd0-4e95-b7f7-4cb30094d328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:12.947526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 893/1783] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:12 2022] DELETE /identity/v3/projects/7fb1f69efd83405a8c27ae8cb1e5e93b => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:12.953879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378db1-d708-46ae-a825-38b8624c6323 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:12.954939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378db1-d708-46ae-a825-38b8624c6323 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:12.955482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378db1-d708-46ae-a825-38b8624c6323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:13.008025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-df378db1-d708-46ae-a825-38b8624c6323 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:13.013799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-df378db1-d708-46ae-a825-38b8624c6323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:13.324379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 891/1784] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:13.336878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0fbab-7aed-468e-a643-cd5392635be2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:13.337555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0fbab-7aed-468e-a643-cd5392635be2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:13.337555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0fbab-7aed-468e-a643-cd5392635be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:13.372521 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c9d0fbab-7aed-468e-a643-cd5392635be2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:13.374303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c9d0fbab-7aed-468e-a643-cd5392635be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:13.428711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 894/1785] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:13.433635 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df378db1-d708-46ae-a825-38b8624c6323 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:13.445667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df378db1-d708-46ae-a825-38b8624c6323 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:13.486960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:13.486960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:13.486960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:13.486960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:13.487705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:13.487705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:13.487705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:13.508902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0fbab-7aed-468e-a643-cd5392635be2 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:13.513986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 892/1786] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:13.522719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0fbab-7aed-468e-a643-cd5392635be2 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:13.532476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f90bfc-cfdd-4780-aed7-8a21a0fea3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:13.533707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90bfc-cfdd-4780-aed7-8a21a0fea3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:13.534913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90bfc-cfdd-4780-aed7-8a21a0fea3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:13.535412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90bfc-cfdd-4780-aed7-8a21a0fea3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:13.536286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f90bfc-cfdd-4780-aed7-8a21a0fea3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:13.538792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f90bfc-cfdd-4780-aed7-8a21a0fea3f1 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:13.736575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 895/1787] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:13 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:13.737969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:13.761296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730749a-28fd-4fe5-88a3-ba0e22ac389e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:13.849523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6f0ff-d67d-474d-bcbc-52e9b3775250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:13.851640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6f0ff-d67d-474d-bcbc-52e9b3775250 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:13.851640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6f0ff-d67d-474d-bcbc-52e9b3775250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:13.851640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6f0ff-d67d-474d-bcbc-52e9b3775250 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:13.851966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6f0ff-d67d-474d-bcbc-52e9b3775250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:13.854437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6f0ff-d67d-474d-bcbc-52e9b3775250 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:14.017661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 893/1788] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:13 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:14.025527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f90bfc-cfdd-4780-aed7-8a21a0fea3f1 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:14.038956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f90bfc-cfdd-4780-aed7-8a21a0fea3f1 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:14.051735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c2dd1-acd7-430e-b04f-df31e62215ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:14.054579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2dd1-acd7-430e-b04f-df31e62215ba admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:14.055641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2dd1-acd7-430e-b04f-df31e62215ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:14.057355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c2dd1-acd7-430e-b04f-df31e62215ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:14.058598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c2dd1-acd7-430e-b04f-df31e62215ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:14.060644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c2dd1-acd7-430e-b04f-df31e62215ba admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:14.086610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6f0ff-d67d-474d-bcbc-52e9b3775250 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:14.087114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 896/1789] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:14.099628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6f0ff-d67d-474d-bcbc-52e9b3775250 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:14.119028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccee34d-4837-46bc-b58f-ee6f5dc1ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:14.123993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee34d-4837-46bc-b58f-ee6f5dc1ba33 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:14.129585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee34d-4837-46bc-b58f-ee6f5dc1ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:14.130373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee34d-4837-46bc-b58f-ee6f5dc1ba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:14.138271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccee34d-4837-46bc-b58f-ee6f5dc1ba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:14.138271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccee34d-4837-46bc-b58f-ee6f5dc1ba33 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:14.155151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 894/1790] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:14.163790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c2dd1-acd7-430e-b04f-df31e62215ba admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:14.172484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c2dd1-acd7-430e-b04f-df31e62215ba admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:14.178083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:14.179212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:14.179680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:14.180139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] PATH_INFO: `/v3/projects/b5d76e6a7dfd480a9b78ccc02a1626b0/users/ae62a41930fc470890096b0d0fcea5af/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:14.223552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d76e6a7dfd480a9b78ccc02a1626b0, user_id=ae62a41930fc470890096b0d0fcea5af, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:14.227868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:14.339029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 897/1791] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:14 2022] PUT /identity/v3/projects/b5d76e6a7dfd480a9b78ccc02a1626b0/users/ae62a41930fc470890096b0d0fcea5af/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:14.343507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868039-ea4a-48c2-9bd6-9c43dfb133ee None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:14.344075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868039-ea4a-48c2-9bd6-9c43dfb133ee None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:14.344517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868039-ea4a-48c2-9bd6-9c43dfb133ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:14.394831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-c0868039-ea4a-48c2-9bd6-9c43dfb133ee None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:14.396074 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c0868039-ea4a-48c2-9bd6-9c43dfb133ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:14.463081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 895/1792] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:14.478388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:14.478388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:14.586169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f684189-f42e-435c-9cd4-559889557f12 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:14.590064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e0d5-76cb-4b27-b6b0-089b9f375618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:14.593212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e0d5-76cb-4b27-b6b0-089b9f375618 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:14.593212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e0d5-76cb-4b27-b6b0-089b9f375618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:14.593212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e0d5-76cb-4b27-b6b0-089b9f375618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:14.607921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e0d5-76cb-4b27-b6b0-089b9f375618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:14.609587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e0d5-76cb-4b27-b6b0-089b9f375618 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:14.621840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 898/1793] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:16.601219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b74c01-0583-4786-adbf-c55b82f0f6af None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:16.601679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b74c01-0583-4786-adbf-c55b82f0f6af None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:16.601794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b74c01-0583-4786-adbf-c55b82f0f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:16.632266 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-d2b74c01-0583-4786-adbf-c55b82f0f6af None None] MFA Rules not processed for user `ae62a41930fc470890096b0d0fcea5af`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:16.633741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d2b74c01-0583-4786-adbf-c55b82f0f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:16.800901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 896/1794] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:16.808653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e0d5-76cb-4b27-b6b0-089b9f375618 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:16.822100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e0d5-76cb-4b27-b6b0-089b9f375618 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:16.839355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2fc37-9960-4585-a576-70abd3129b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:16.840614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2fc37-9960-4585-a576-70abd3129b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:16.841096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2fc37-9960-4585-a576-70abd3129b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:16.841761 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2fc37-9960-4585-a576-70abd3129b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:16.842729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2fc37-9960-4585-a576-70abd3129b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:16.845880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2fc37-9960-4585-a576-70abd3129b37 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:16.888514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b74c01-0583-4786-adbf-c55b82f0f6af None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:16.889975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d2b74c01-0583-4786-adbf-c55b82f0f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:16.909032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b74c01-0583-4786-adbf-c55b82f0f6af None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:16.934015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:16.939572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:16.940044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:16.941149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] PATH_INFO: `/v3/users/093bfda8547844eeada205b4e3cb0a7c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:16.944623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=093bfda8547844eeada205b4e3cb0a7c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:16.952177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:16.998877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 899/1795] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:16 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:17.000420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2fc37-9960-4585-a576-70abd3129b37 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:17.196097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2fc37-9960-4585-a576-70abd3129b37 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:17.201739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:17.203392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:17.203392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:17.203392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:17.203797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:17.206496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:17.215847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093bfda8547844eeada205b4e3cb0a7c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:17.217589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093bfda8547844eeada205b4e3cb0a7c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:17.227670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093bfda8547844eeada205b4e3cb0a7c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:17.228617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093bfda8547844eeada205b4e3cb0a7c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:17.295699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 900/1796] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:16 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:17.299608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:17.301588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:17.315246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-9425d24b-e088-4759-8245-7e860e7afe7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093bfda8547844eeada205b4e3cb0a7c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:17.321045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e7588-45ff-4e96-81e6-d673128ad1ad admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:17.336271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d2b98-22d2-4f06-8937-fc1295e5e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:17.336884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d2b98-22d2-4f06-8937-fc1295e5e2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:17.337173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d2b98-22d2-4f06-8937-fc1295e5e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:17.337451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d2b98-22d2-4f06-8937-fc1295e5e2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:17.338200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d2b98-22d2-4f06-8937-fc1295e5e2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:17.339868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d2b98-22d2-4f06-8937-fc1295e5e2a9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:17.344149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 897/1797] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:16 2022] DELETE /identity/v3/users/093bfda8547844eeada205b4e3cb0a7c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:17.348808 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a41d-4e5f-4095-b737-e2d2f1ebf1bc None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:17.353269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a41d-4e5f-4095-b737-e2d2f1ebf1bc None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:17.353269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a41d-4e5f-4095-b737-e2d2f1ebf1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:17.357626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 901/1798] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:17.358777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d2b98-22d2-4f06-8937-fc1295e5e2a9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:17.368745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-84e2a41d-4e5f-4095-b737-e2d2f1ebf1bc None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:17.370004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d2b98-22d2-4f06-8937-fc1295e5e2a9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:17.370137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-84e2a41d-4e5f-4095-b737-e2d2f1ebf1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:17.509071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 898/1799] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:17.521165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926a61a-be2c-434f-b0db-3345a918b8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:17.522648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a61a-be2c-434f-b0db-3345a918b8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:17.523121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a61a-be2c-434f-b0db-3345a918b8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:17.523450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926a61a-be2c-434f-b0db-3345a918b8e5 admin admin] PATH_INFO: `/v3/projects/16e68e0ccff8494baeefe2d4bd79b5c0/users/c72e5b86c0ed4eff991c552d155f9d79/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:17.540705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926a61a-be2c-434f-b0db-3345a918b8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e68e0ccff8494baeefe2d4bd79b5c0, user_id=c72e5b86c0ed4eff991c552d155f9d79, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:17.547559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926a61a-be2c-434f-b0db-3345a918b8e5 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:17.589794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a41d-4e5f-4095-b737-e2d2f1ebf1bc None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:17.591936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-84e2a41d-4e5f-4095-b737-e2d2f1ebf1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:17.654568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 902/1800] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:17 2022] PUT /identity/v3/projects/16e68e0ccff8494baeefe2d4bd79b5c0/users/c72e5b86c0ed4eff991c552d155f9d79/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:17.659218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926a61a-be2c-434f-b0db-3345a918b8e5 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:17.768938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a41d-4e5f-4095-b737-e2d2f1ebf1bc None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:17.826060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926a61a-be2c-434f-b0db-3345a918b8e5 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:17.841793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5673f7-23e0-475a-b778-ab901da97bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:17.844669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5673f7-23e0-475a-b778-ab901da97bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:17.845497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5673f7-23e0-475a-b778-ab901da97bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:17.845779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5673f7-23e0-475a-b778-ab901da97bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:17.848243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5673f7-23e0-475a-b778-ab901da97bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:17.851770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5673f7-23e0-475a-b778-ab901da97bbe admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:17.879469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:17.880306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:17.880696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:17.881076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:17.885010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 903/1801] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:17.886204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5673f7-23e0-475a-b778-ab901da97bbe admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:17.903765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:17.905413 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:17.905857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5673f7-23e0-475a-b778-ab901da97bbe admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:17.917903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363620c-c113-4066-8302-323304238db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:17.919220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363620c-c113-4066-8302-323304238db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:17.919724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363620c-c113-4066-8302-323304238db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:17.920220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363620c-c113-4066-8302-323304238db9 admin admin] PATH_INFO: `/v3/projects/16e68e0ccff8494baeefe2d4bd79b5c0/users/c72e5b86c0ed4eff991c552d155f9d79/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:17.925667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363620c-c113-4066-8302-323304238db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e68e0ccff8494baeefe2d4bd79b5c0, user_id=c72e5b86c0ed4eff991c552d155f9d79, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:17.931171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 899/1802] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:17.931559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363620c-c113-4066-8302-323304238db9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:17.946918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 904/1803] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:17 2022] PUT /identity/v3/projects/16e68e0ccff8494baeefe2d4bd79b5c0/users/c72e5b86c0ed4eff991c552d155f9d79/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:18.008987 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:18.011624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:18.026973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45dadd-28a9-474e-bb56-15c96bc69ae1 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:18.093870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:18.095409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:18.095700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:18.095981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] PATH_INFO: `/v3/users/e90195309d8c4730bcf4ad69aaf44ac5` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:18.099170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90195309d8c4730bcf4ad69aaf44ac5)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:18.107231 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:18.356659 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90195309d8c4730bcf4ad69aaf44ac5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:18.357399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90195309d8c4730bcf4ad69aaf44ac5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:18.364857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90195309d8c4730bcf4ad69aaf44ac5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:18.365516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90195309d8c4730bcf4ad69aaf44ac5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:18.427808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363620c-c113-4066-8302-323304238db9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:18.428005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1363620c-c113-4066-8302-323304238db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:18.448314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363620c-c113-4066-8302-323304238db9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:18.453484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:18.454422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:18.454728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:18.455004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] PATH_INFO: `/v3/projects/75c9da493b53402fafaad643d8d5ce25` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:18.458667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c9da493b53402fafaad643d8d5ce25)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:18.458667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:18.476624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2936162e-5f22-47e6-8e41-ee9489eee57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90195309d8c4730bcf4ad69aaf44ac5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:18.504789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 900/1804] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:18 2022] DELETE /identity/v3/users/e90195309d8c4730bcf4ad69aaf44ac5 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:18.509149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dabb67-bc3d-431f-8df8-7d9ed27e499c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:18.509446 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dabb67-bc3d-431f-8df8-7d9ed27e499c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:18.509732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dabb67-bc3d-431f-8df8-7d9ed27e499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:18.528791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f9dabb67-bc3d-431f-8df8-7d9ed27e499c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:18.530023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f9dabb67-bc3d-431f-8df8-7d9ed27e499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:18.622636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 901/1805] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:18.633756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dabb67-bc3d-431f-8df8-7d9ed27e499c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:18.635252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f9dabb67-bc3d-431f-8df8-7d9ed27e499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:18.718070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dabb67-bc3d-431f-8df8-7d9ed27e499c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:18.727377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bc82b-d94f-4430-b442-ef1da5a18ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:18.727942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc82b-d94f-4430-b442-ef1da5a18ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:18.728303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc82b-d94f-4430-b442-ef1da5a18ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:18.728653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bc82b-d94f-4430-b442-ef1da5a18ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:18.759612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bc82b-d94f-4430-b442-ef1da5a18ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:18.761351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bc82b-d94f-4430-b442-ef1da5a18ee1 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:18.775767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 902/1806] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:19.172114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c9da493b53402fafaad643d8d5ce25', 'request_id': 'req-dc8c4170-df56-40ac-80c1-e6af4448f253'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:19.515999 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c9da493b53402fafaad643d8d5ce25', 'request_id': 'req-dc8c4170-df56-40ac-80c1-e6af4448f253'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:19.538214 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c9da493b53402fafaad643d8d5ce25', 'request_id': 'req-dc8c4170-df56-40ac-80c1-e6af4448f253'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:19.557414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] The token cache is being invalidate because project 75c9da493b53402fafaad643d8d5ce25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:19.558207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:19.558797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:19.581823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 905/1807] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:18 2022] DELETE /identity/v3/projects/75c9da493b53402fafaad643d8d5ce25 => generated 0 bytes in 1156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:19.586190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bc82b-d94f-4430-b442-ef1da5a18ee1 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:19.602886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bc82b-d94f-4430-b442-ef1da5a18ee1 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:19.706087 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:19.710805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:19.710805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:19.710805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] PATH_INFO: `/v3/users/982191e367de4876b9b4f0d02773752a` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:19.710805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982191e367de4876b9b4f0d02773752a)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:19.711106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:19.840292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:19.844490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:19.877213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c4170-df56-40ac-80c1-e6af4448f253 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:19.887687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:19.888983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:19.889416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:19.889924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] PATH_INFO: `/v3/projects/27aed956c9e041b49d334fd01a51f02c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:19.894599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27aed956c9e041b49d334fd01a51f02c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:19.894599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:19.965273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982191e367de4876b9b4f0d02773752a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:19.965273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982191e367de4876b9b4f0d02773752a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:19.972750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982191e367de4876b9b4f0d02773752a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:19.973971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982191e367de4876b9b4f0d02773752a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.043783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982191e367de4876b9b4f0d02773752a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.113544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 903/1808] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:19 2022] DELETE /identity/v3/users/982191e367de4876b9b4f0d02773752a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:20.148985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27aed956c9e041b49d334fd01a51f02c', 'request_id': 'req-421cfd10-1e1a-4efb-a62a-a39dc927ee93'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.223741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27aed956c9e041b49d334fd01a51f02c', 'request_id': 'req-421cfd10-1e1a-4efb-a62a-a39dc927ee93'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.232623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27aed956c9e041b49d334fd01a51f02c', 'request_id': 'req-421cfd10-1e1a-4efb-a62a-a39dc927ee93'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.250739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] The token cache is being invalidate because project 27aed956c9e041b49d334fd01a51f02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:20.251628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.253809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.257659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 906/1809] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:19 2022] DELETE /identity/v3/projects/27aed956c9e041b49d334fd01a51f02c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:20.261825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:20.263308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:20.381654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff19862-ba24-4ef6-9607-e2afc0970e09 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:20.390700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:20.392242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:20.392537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:20.395078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] PATH_INFO: `/v3/users/73b0016e2e124444a1db496b0324a51a` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:20.395078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b0016e2e124444a1db496b0324a51a)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:20.396221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:20.642390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b0016e2e124444a1db496b0324a51a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.643608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b0016e2e124444a1db496b0324a51a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.660632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b0016e2e124444a1db496b0324a51a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.660632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b0016e2e124444a1db496b0324a51a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.743688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c09aacbe-e517-4dc5-9885-4fb82e76522a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b0016e2e124444a1db496b0324a51a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:20.764540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 904/1810] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:20 2022] DELETE /identity/v3/users/73b0016e2e124444a1db496b0324a51a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:21.202789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:21.205814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:21.250272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00977c6-8ea2-495f-94fe-9fdedf0c7df5 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:21.253306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00977c6-8ea2-495f-94fe-9fdedf0c7df5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:21.253306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00977c6-8ea2-495f-94fe-9fdedf0c7df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:21.322414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e00977c6-8ea2-495f-94fe-9fdedf0c7df5 None None] MFA Rules not processed for user `c72e5b86c0ed4eff991c552d155f9d79`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:21.324961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cfd10-1e1a-4efb-a62a-a39dc927ee93 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:21.327083 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e00977c6-8ea2-495f-94fe-9fdedf0c7df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:21.437958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:21.438956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:21.439247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:21.439531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] PATH_INFO: `/v3/projects/cf5fdb818d424f95aa8028d7236d2ba4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:21.441796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5fdb818d424f95aa8028d7236d2ba4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:21.443979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:21.459329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 905/1811] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:21.498681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00977c6-8ea2-495f-94fe-9fdedf0c7df5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:21.500272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e00977c6-8ea2-495f-94fe-9fdedf0c7df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:21.558776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00977c6-8ea2-495f-94fe-9fdedf0c7df5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:21.563074 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:21.564278 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:21.565104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:21.565398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:21.567386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:21.600179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5fdb818d424f95aa8028d7236d2ba4', 'request_id': 'req-1787581e-fd3b-4433-a517-90fe5f6028f7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:21.632935 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:21.639893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:21.643359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 906/1812] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:21.687117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5fdb818d424f95aa8028d7236d2ba4', 'request_id': 'req-1787581e-fd3b-4433-a517-90fe5f6028f7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:21.695412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5fdb818d424f95aa8028d7236d2ba4', 'request_id': 'req-1787581e-fd3b-4433-a517-90fe5f6028f7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:21.702321 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:21.704455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:21.729659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] The token cache is being invalidate because project cf5fdb818d424f95aa8028d7236d2ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:21.729659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:21.730926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1787581e-fd3b-4433-a517-90fe5f6028f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:21.731787 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958156a-1b02-4cc5-b684-711dba806eb4 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:21.740703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 907/1813] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:21 2022] DELETE /identity/v3/projects/cf5fdb818d424f95aa8028d7236d2ba4 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:21.748244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81d16-c082-434d-9d02-10fb314a777e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:21.748548 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81d16-c082-434d-9d02-10fb314a777e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:21.755125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c81d16-c082-434d-9d02-10fb314a777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:21.809088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-30c81d16-c082-434d-9d02-10fb314a777e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:21.810968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-30c81d16-c082-434d-9d02-10fb314a777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:21.869138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:21.870412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:21.872026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:21.872390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] PATH_INFO: `/v3/projects/fd8f5a3416ac45b190a12929a6f1e76a` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:21.874611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8f5a3416ac45b190a12929a6f1e76a)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:21.876397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:21.935188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 908/1814] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:21.938710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526c41-9f55-4859-8c33-74e23cac614c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:21.939304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526c41-9f55-4859-8c33-74e23cac614c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:21.939660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526c41-9f55-4859-8c33-74e23cac614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:21.963589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f1526c41-9f55-4859-8c33-74e23cac614c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:21.965666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f1526c41-9f55-4859-8c33-74e23cac614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:21.979372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 909/1815] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:21.983591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526c41-9f55-4859-8c33-74e23cac614c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:21.995360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526c41-9f55-4859-8c33-74e23cac614c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.006883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.006883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.006883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.006883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.007358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:22.007358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.007358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.023728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8f5a3416ac45b190a12929a6f1e76a', 'request_id': 'req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:22.032022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 910/1816] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:22.036875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.055865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10a98-cfc2-4bb7-9423-7302daf6b660 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.119698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.120511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.120868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.121217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.121996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.124074 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.135766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8f5a3416ac45b190a12929a6f1e76a', 'request_id': 'req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:22.142673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8f5a3416ac45b190a12929a6f1e76a', 'request_id': 'req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:22.162316 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] The token cache is being invalidate because project fd8f5a3416ac45b190a12929a6f1e76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:22.162971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:22.163842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b4e7bd25-265c-4ecf-b671-bd3e06ee64c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:22.173038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 907/1817] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:21 2022] DELETE /identity/v3/projects/fd8f5a3416ac45b190a12929a6f1e76a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:22.183939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e3c8d-5d34-4f10-ab60-a7fe78046b8c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.183939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e3c8d-5d34-4f10-ab60-a7fe78046b8c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.183939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e3c8d-5d34-4f10-ab60-a7fe78046b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.207882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-2b8e3c8d-5d34-4f10-ab60-a7fe78046b8c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:22.209680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2b8e3c8d-5d34-4f10-ab60-a7fe78046b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:22.232587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 908/1818] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:22.234598 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0947f-9f6e-40e3-b347-58e4c7d1f42c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.235775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0947f-9f6e-40e3-b347-58e4c7d1f42c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.235775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0947f-9f6e-40e3-b347-58e4c7d1f42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.239081 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 911/1819] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:22 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:22.239998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.243031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:22.272566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-94c0947f-9f6e-40e3-b347-58e4c7d1f42c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:22.273805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-94c0947f-9f6e-40e3-b347-58e4c7d1f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:22.328466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8c249-2880-4bf7-a711-1132e8027d52 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.334344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9829a46-e8df-4d8f-b0f2-6e423fa70331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.335129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829a46-e8df-4d8f-b0f2-6e423fa70331 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.335495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829a46-e8df-4d8f-b0f2-6e423fa70331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.335855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9829a46-e8df-4d8f-b0f2-6e423fa70331 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.336766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9829a46-e8df-4d8f-b0f2-6e423fa70331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.338949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9829a46-e8df-4d8f-b0f2-6e423fa70331 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.358572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 909/1820] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:22.364052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0947f-9f6e-40e3-b347-58e4c7d1f42c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.380940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0947f-9f6e-40e3-b347-58e4c7d1f42c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.389378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.389378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.389378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.389378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.389937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:22.389937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.390671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.419880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 910/1821] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:22.425732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.439563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 912/1822] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:22 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:22.441253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cd6ad-1978-49e9-abb5-0fbee8283473 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.447685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9829a46-e8df-4d8f-b0f2-6e423fa70331 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.449908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5e7b9-3a0f-4c47-8477-aec8ff09a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.452969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e7b9-3a0f-4c47-8477-aec8ff09a6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.453928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e7b9-3a0f-4c47-8477-aec8ff09a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.455045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e7b9-3a0f-4c47-8477-aec8ff09a6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.457407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5e7b9-3a0f-4c47-8477-aec8ff09a6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.461387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5e7b9-3a0f-4c47-8477-aec8ff09a6c9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.469883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9829a46-e8df-4d8f-b0f2-6e423fa70331 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.481336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3289-ff3f-4b85-aec7-763f89b05304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.482030 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3289-ff3f-4b85-aec7-763f89b05304 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.484166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3289-ff3f-4b85-aec7-763f89b05304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.484616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f3289-ff3f-4b85-aec7-763f89b05304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.485436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f3289-ff3f-4b85-aec7-763f89b05304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.487164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f3289-ff3f-4b85-aec7-763f89b05304 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.504479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 913/1823] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:22.508596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3289-ff3f-4b85-aec7-763f89b05304 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.520582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f3289-ff3f-4b85-aec7-763f89b05304 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.528874 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdab71-13bd-4e24-b3be-7abe8c939248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.529691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdab71-13bd-4e24-b3be-7abe8c939248 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.530083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdab71-13bd-4e24-b3be-7abe8c939248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.530468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdab71-13bd-4e24-b3be-7abe8c939248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.531440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdab71-13bd-4e24-b3be-7abe8c939248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.533502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdab71-13bd-4e24-b3be-7abe8c939248 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.550635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 914/1824] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:22.554904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdab71-13bd-4e24-b3be-7abe8c939248 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.568366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 911/1825] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:22 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:22.570011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5e7b9-3a0f-4c47-8477-aec8ff09a6c9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.580340 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdab71-13bd-4e24-b3be-7abe8c939248 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.680565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d72d5-b1c1-4ae7-8b76-ba3190edc626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.680565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d72d5-b1c1-4ae7-8b76-ba3190edc626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.681239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d72d5-b1c1-4ae7-8b76-ba3190edc626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.681631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d72d5-b1c1-4ae7-8b76-ba3190edc626 admin admin] PATH_INFO: `/v3/projects/f2f89d2cd32b41bdb9a560c90657292e/users/45285c4d9564479687346c544a048eda/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.699726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5e7b9-3a0f-4c47-8477-aec8ff09a6c9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.706322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7264d-78f9-4f69-9cf7-8cee91dd5fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.707283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7264d-78f9-4f69-9cf7-8cee91dd5fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.707799 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7264d-78f9-4f69-9cf7-8cee91dd5fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.708251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7264d-78f9-4f69-9cf7-8cee91dd5fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.708504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d72d5-b1c1-4ae7-8b76-ba3190edc626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f89d2cd32b41bdb9a560c90657292e, user_id=45285c4d9564479687346c544a048eda, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.709254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7264d-78f9-4f69-9cf7-8cee91dd5fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.711617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7264d-78f9-4f69-9cf7-8cee91dd5fe2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.716283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d72d5-b1c1-4ae7-8b76-ba3190edc626 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.824495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 915/1826] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:22 2022] PUT /identity/v3/projects/f2f89d2cd32b41bdb9a560c90657292e/users/45285c4d9564479687346c544a048eda/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:22.826148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298687f-f306-4812-bbd6-c5542bf6aedf None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.826447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298687f-f306-4812-bbd6-c5542bf6aedf None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.826795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298687f-f306-4812-bbd6-c5542bf6aedf None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.836067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 912/1827] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:22 2022] POST /identity/v3/users => generated 292 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:22.837770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefb76c-d5be-4177-96af-c0b87f2d2b93 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.843080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefb76c-d5be-4177-96af-c0b87f2d2b93 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.843080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefb76c-d5be-4177-96af-c0b87f2d2b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.843863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 916/1828] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:39:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:39:22.843948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298687f-f306-4812-bbd6-c5542bf6aedf None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.876524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-baefb76c-d5be-4177-96af-c0b87f2d2b93 None None] MFA Rules not processed for user `45285c4d9564479687346c544a048eda`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:22.878724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-baefb76c-d5be-4177-96af-c0b87f2d2b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:22.930663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298687f-f306-4812-bbd6-c5542bf6aedf None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.937455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91242af1-0361-4062-86db-e82d286a0996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:22.938968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242af1-0361-4062-86db-e82d286a0996 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.939271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242af1-0361-4062-86db-e82d286a0996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.939604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242af1-0361-4062-86db-e82d286a0996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.940375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91242af1-0361-4062-86db-e82d286a0996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:22.942011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91242af1-0361-4062-86db-e82d286a0996 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:22.956300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 917/1829] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:22.960025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 913/1830] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:22.960143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0241-8fa3-43e1-b326-03e557879dde None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:22.960143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0241-8fa3-43e1-b326-03e557879dde None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:22.960143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d0241-8fa3-43e1-b326-03e557879dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:22.962467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefb76c-d5be-4177-96af-c0b87f2d2b93 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:22.974610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefb76c-d5be-4177-96af-c0b87f2d2b93 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:22.981392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-339d0241-8fa3-43e1-b326-03e557879dde None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:22.982759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-339d0241-8fa3-43e1-b326-03e557879dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:22.993831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93960756-eadb-448c-8998-befa4b2bf03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.008686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960756-eadb-448c-8998-befa4b2bf03f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.009340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960756-eadb-448c-8998-befa4b2bf03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.009954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960756-eadb-448c-8998-befa4b2bf03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.020015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93960756-eadb-448c-8998-befa4b2bf03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.023521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93960756-eadb-448c-8998-befa4b2bf03f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.047927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 914/1831] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:23.047927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93960756-eadb-448c-8998-befa4b2bf03f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.063180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93960756-eadb-448c-8998-befa4b2bf03f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.070814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.072092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.073570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.074752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.076076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.078473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.112724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 918/1832] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:23.113958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d0241-8fa3-43e1-b326-03e557879dde None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.125691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d0241-8fa3-43e1-b326-03e557879dde None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.132918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b641-e11b-41c1-bfd2-1124a0502e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.133472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b641-e11b-41c1-bfd2-1124a0502e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.133761 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b641-e11b-41c1-bfd2-1124a0502e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.134043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b641-e11b-41c1-bfd2-1124a0502e96 admin admin] PATH_INFO: `/v3/projects/e1a30b63d07d4315b884e962f31f2e36/users/3984bffff3ff4755a88611b5bd4d209b/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.152945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4b641-e11b-41c1-bfd2-1124a0502e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a30b63d07d4315b884e962f31f2e36, user_id=3984bffff3ff4755a88611b5bd4d209b, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.155947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4b641-e11b-41c1-bfd2-1124a0502e96 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.182618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 915/1833] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:23 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:23.182618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.182618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:23.246738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 919/1834] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:23 2022] PUT /identity/v3/projects/e1a30b63d07d4315b884e962f31f2e36/users/3984bffff3ff4755a88611b5bd4d209b/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:23.247983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b641-e11b-41c1-bfd2-1124a0502e96 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.280918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76359947-6f11-4818-b751-32e43bbe2f87 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.348886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b641-e11b-41c1-bfd2-1124a0502e96 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.355418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4ba0-8f05-4794-941f-b2a0c2f37247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.355751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4ba0-8f05-4794-941f-b2a0c2f37247 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.356048 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4ba0-8f05-4794-941f-b2a0c2f37247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.356330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4ba0-8f05-4794-941f-b2a0c2f37247 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.357037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4ba0-8f05-4794-941f-b2a0c2f37247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.359728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4ba0-8f05-4794-941f-b2a0c2f37247 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.365399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d4a7-f741-481f-b97e-d28e9f3374c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.366072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d4a7-f741-481f-b97e-d28e9f3374c7 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.366361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d4a7-f741-481f-b97e-d28e9f3374c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.366668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d4a7-f741-481f-b97e-d28e9f3374c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.379340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7d4a7-f741-481f-b97e-d28e9f3374c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.381238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7d4a7-f741-481f-b97e-d28e9f3374c7 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.393007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 916/1835] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:23.396199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b843-60de-41a6-acf4-c1429363ac27 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.406044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b843-60de-41a6-acf4-c1429363ac27 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.406044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b843-60de-41a6-acf4-c1429363ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.449056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5675b843-60de-41a6-acf4-c1429363ac27 None None] MFA Rules not processed for user `3984bffff3ff4755a88611b5bd4d209b`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:23.454743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5675b843-60de-41a6-acf4-c1429363ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:23.484301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 920/1836] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:23 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:23.489171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4ba0-8f05-4794-941f-b2a0c2f37247 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.513066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4ba0-8f05-4794-941f-b2a0c2f37247 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.520788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.521493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.521794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.522079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.523279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.524980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.543412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 921/1837] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:23.543412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.553202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:23.568681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 917/1838] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:23.572478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675b843-60de-41a6-acf4-c1429363ac27 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.580922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675b843-60de-41a6-acf4-c1429363ac27 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.587058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335600f5-1b5e-45fa-917d-403007e6136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.587979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335600f5-1b5e-45fa-917d-403007e6136f admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.588267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335600f5-1b5e-45fa-917d-403007e6136f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.588540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335600f5-1b5e-45fa-917d-403007e6136f admin admin] PATH_INFO: `/v3/projects/990d77b02be54ac5b67bbea2d79bd874/users/ec03745f603a48c4a51b76d54780ac6a/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.608975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335600f5-1b5e-45fa-917d-403007e6136f admin admin] RBAC: Authorizing `identity:create_grant(project_id=990d77b02be54ac5b67bbea2d79bd874, user_id=ec03745f603a48c4a51b76d54780ac6a, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.612337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335600f5-1b5e-45fa-917d-403007e6136f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.618015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935f6e2-b5c7-4294-a570-72d8c36b63ea admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.621837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.622491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.622813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.623092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.624982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:23.689752 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.691251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.701462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 922/1839] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:23.702152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.704117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:23.705184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 918/1840] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:23 2022] PUT /identity/v3/projects/990d77b02be54ac5b67bbea2d79bd874/users/ec03745f603a48c4a51b76d54780ac6a/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:23.709029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335600f5-1b5e-45fa-917d-403007e6136f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.715279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516232-dd1b-45b4-9537-4edaef180fc4 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.774341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335600f5-1b5e-45fa-917d-403007e6136f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.779439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843dba2-edf8-4ef5-97ae-2ff32b13ba68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.780267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d3137-05b9-416d-8765-730364757b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.780482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843dba2-edf8-4ef5-97ae-2ff32b13ba68 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.780881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843dba2-edf8-4ef5-97ae-2ff32b13ba68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.780999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3137-05b9-416d-8765-730364757b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.781206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3137-05b9-416d-8765-730364757b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.781421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843dba2-edf8-4ef5-97ae-2ff32b13ba68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.781522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3137-05b9-416d-8765-730364757b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.783045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d3137-05b9-416d-8765-730364757b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.787092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d3137-05b9-416d-8765-730364757b5e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.796341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 919/1841] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:23.801537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6b14-9618-41d1-b707-be704c4cc687 None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.801759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6b14-9618-41d1-b707-be704c4cc687 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.802009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6b14-9618-41d1-b707-be704c4cc687 None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.803788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 920/1842] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:39:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:39:23.804537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f6b14-9618-41d1-b707-be704c4cc687 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.818220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f6b14-9618-41d1-b707-be704c4cc687 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:23.823105 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b74eb8-06e4-4272-807c-bf6e8b851e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:23.823988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b74eb8-06e4-4272-807c-bf6e8b851e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.824271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b74eb8-06e4-4272-807c-bf6e8b851e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.824550 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b74eb8-06e4-4272-807c-bf6e8b851e24 admin admin] PATH_INFO: `/v3/projects/990d77b02be54ac5b67bbea2d79bd874/users/ec03745f603a48c4a51b76d54780ac6a/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.826618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b74eb8-06e4-4272-807c-bf6e8b851e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990d77b02be54ac5b67bbea2d79bd874, user_id=ec03745f603a48c4a51b76d54780ac6a, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.829351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b74eb8-06e4-4272-807c-bf6e8b851e24 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.840097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 921/1843] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:23 2022] PUT /identity/v3/projects/990d77b02be54ac5b67bbea2d79bd874/users/ec03745f603a48c4a51b76d54780ac6a/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:23.847963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c3d8-aab5-42ff-998a-1e88d315d7d2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.848255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c3d8-aab5-42ff-998a-1e88d315d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.848599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473c3d8-aab5-42ff-998a-1e88d315d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.852694 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843dba2-edf8-4ef5-97ae-2ff32b13ba68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:23.854376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843dba2-edf8-4ef5-97ae-2ff32b13ba68 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:23.865392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 923/1844] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:23.867030 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071edf-44a6-4d18-a340-c14351add7ea None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:23.867414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071edf-44a6-4d18-a340-c14351add7ea None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:23.867592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071edf-44a6-4d18-a340-c14351add7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:23.874764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-8473c3d8-aab5-42ff-998a-1e88d315d7d2 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:23.881901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8473c3d8-aab5-42ff-998a-1e88d315d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:23.896865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-46071edf-44a6-4d18-a340-c14351add7ea None None] MFA Rules not processed for user `ec03745f603a48c4a51b76d54780ac6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:23.898151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-46071edf-44a6-4d18-a340-c14351add7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:23.972038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 922/1845] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:23.987924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473c3d8-aab5-42ff-998a-1e88d315d7d2 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:23.988560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 924/1846] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:23.989607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8473c3d8-aab5-42ff-998a-1e88d315d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:24.004193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473c3d8-aab5-42ff-998a-1e88d315d7d2 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:24.010484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194125-8c1a-42ac-9437-61a6ee8d93fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:24.011372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194125-8c1a-42ac-9437-61a6ee8d93fd service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:24.011462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194125-8c1a-42ac-9437-61a6ee8d93fd service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:24.011715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194125-8c1a-42ac-9437-61a6ee8d93fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:24.027777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194125-8c1a-42ac-9437-61a6ee8d93fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:24.027777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194125-8c1a-42ac-9437-61a6ee8d93fd service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:24.050474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 923/1847] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:24.058925 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46071edf-44a6-4d18-a340-c14351add7ea None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:24.120259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46071edf-44a6-4d18-a340-c14351add7ea None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:24.124615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cb6f7-2f6d-4cfc-8632-ce9b23c76ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:24.125410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cb6f7-2f6d-4cfc-8632-ce9b23c76ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:24.125700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cb6f7-2f6d-4cfc-8632-ce9b23c76ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:24.126093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cb6f7-2f6d-4cfc-8632-ce9b23c76ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:24.138317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cb6f7-2f6d-4cfc-8632-ce9b23c76ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:24.139808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cb6f7-2f6d-4cfc-8632-ce9b23c76ec3 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:24.150848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 925/1848] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:24.179562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194125-8c1a-42ac-9437-61a6ee8d93fd service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:24.260301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194125-8c1a-42ac-9437-61a6ee8d93fd service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:24.265608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:24.267055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:24.267344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:24.267618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] PATH_INFO: `/v3/users/45285c4d9564479687346c544a048eda` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:24.268835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45285c4d9564479687346c544a048eda)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:24.270833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:24.482789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45285c4d9564479687346c544a048eda'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:24.483464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45285c4d9564479687346c544a048eda'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:24.490118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45285c4d9564479687346c544a048eda'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:24.490788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45285c4d9564479687346c544a048eda'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:24.566251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45285c4d9564479687346c544a048eda'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:24.588721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 924/1849] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:24 2022] DELETE /identity/v3/users/45285c4d9564479687346c544a048eda => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:24.599225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fcc60-a4d6-4477-9742-3cebcae05990 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:24.599791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fcc60-a4d6-4477-9742-3cebcae05990 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:24.599906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fcc60-a4d6-4477-9742-3cebcae05990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:24.619262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-296fcc60-a4d6-4477-9742-3cebcae05990 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:24.622705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-296fcc60-a4d6-4477-9742-3cebcae05990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:24.691656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 926/1850] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:24.701250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:24.702900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:24.762823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06e9af-9d70-4502-a884-b54c4ddb578f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:24.767324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942674f-0a80-474f-bb42-904045c9f74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:24.767973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942674f-0a80-474f-bb42-904045c9f74f service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:24.772775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942674f-0a80-474f-bb42-904045c9f74f service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:24.772775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942674f-0a80-474f-bb42-904045c9f74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:24.777425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942674f-0a80-474f-bb42-904045c9f74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:24.778953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942674f-0a80-474f-bb42-904045c9f74f service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:24.788522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 925/1851] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:25.191357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fcc60-a4d6-4477-9742-3cebcae05990 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:25.192885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-296fcc60-a4d6-4477-9742-3cebcae05990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:25.205226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fcc60-a4d6-4477-9742-3cebcae05990 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:25.212280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:25.213163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:25.213436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:25.213714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] PATH_INFO: `/v3/projects/f2f89d2cd32b41bdb9a560c90657292e` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:25.216915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f89d2cd32b41bdb9a560c90657292e)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:25.218901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:25.349427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f89d2cd32b41bdb9a560c90657292e', 'request_id': 'req-5574c0dc-3c16-4bfe-aa92-5326884a84a9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.423823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f89d2cd32b41bdb9a560c90657292e', 'request_id': 'req-5574c0dc-3c16-4bfe-aa92-5326884a84a9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.429565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f89d2cd32b41bdb9a560c90657292e', 'request_id': 'req-5574c0dc-3c16-4bfe-aa92-5326884a84a9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.441840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] The token cache is being invalidate because project f2f89d2cd32b41bdb9a560c90657292e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:25.442075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.442786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.444619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 927/1852] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:25 2022] DELETE /identity/v3/projects/f2f89d2cd32b41bdb9a560c90657292e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:25.448329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942674f-0a80-474f-bb42-904045c9f74f service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:25.458457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942674f-0a80-474f-bb42-904045c9f74f service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:25.519966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:25.520859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:25.521148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:25.521425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] PATH_INFO: `/v3/users/ec03745f603a48c4a51b76d54780ac6a` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:25.522684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec03745f603a48c4a51b76d54780ac6a)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:25.524827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:25.745403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec03745f603a48c4a51b76d54780ac6a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.746102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec03745f603a48c4a51b76d54780ac6a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.753087 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec03745f603a48c4a51b76d54780ac6a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.753737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec03745f603a48c4a51b76d54780ac6a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.811649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d153596-2dcb-4a4d-b118-b313e1692e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec03745f603a48c4a51b76d54780ac6a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:25.829720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 926/1853] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:25 2022] DELETE /identity/v3/users/ec03745f603a48c4a51b76d54780ac6a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:26.308690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:26.311228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:26.338843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574c0dc-3c16-4bfe-aa92-5326884a84a9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:26.431307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:26.432581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:26.434043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:26.434043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] PATH_INFO: `/v3/projects/990d77b02be54ac5b67bbea2d79bd874` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:26.434900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=990d77b02be54ac5b67bbea2d79bd874)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:26.444712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:26.612244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990d77b02be54ac5b67bbea2d79bd874', 'request_id': 'req-b696867b-5af6-4c56-afcf-cc44db690396'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:26.718521 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990d77b02be54ac5b67bbea2d79bd874', 'request_id': 'req-b696867b-5af6-4c56-afcf-cc44db690396'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:26.728240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990d77b02be54ac5b67bbea2d79bd874', 'request_id': 'req-b696867b-5af6-4c56-afcf-cc44db690396'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:26.760082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] The token cache is being invalidate because project 990d77b02be54ac5b67bbea2d79bd874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:26.760388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:26.763064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b696867b-5af6-4c56-afcf-cc44db690396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:26.765696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 928/1854] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:26 2022] DELETE /identity/v3/projects/990d77b02be54ac5b67bbea2d79bd874 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:26.773833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822d410-6c27-4c56-8c5f-e666c9f64fb6 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:26.774418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822d410-6c27-4c56-8c5f-e666c9f64fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:26.774418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822d410-6c27-4c56-8c5f-e666c9f64fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:26.794020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9822d410-6c27-4c56-8c5f-e666c9f64fb6 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:26.795365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9822d410-6c27-4c56-8c5f-e666c9f64fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:26.869883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 927/1855] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:26.878310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4342cd-8632-4e21-8786-b894fa2aea45 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:26.878638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4342cd-8632-4e21-8786-b894fa2aea45 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:26.878935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4342cd-8632-4e21-8786-b894fa2aea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:26.901598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-7f4342cd-8632-4e21-8786-b894fa2aea45 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:26.903313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-7f4342cd-8632-4e21-8786-b894fa2aea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:26.915561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 929/1856] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:26.919881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822d410-6c27-4c56-8c5f-e666c9f64fb6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:26.931770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822d410-6c27-4c56-8c5f-e666c9f64fb6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:26.936932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:26.937990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:26.938304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:26.938638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:26.939377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:26.939834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:26.941558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:26.954647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 928/1857] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:26.959059 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4342cd-8632-4e21-8786-b894fa2aea45 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:26.968126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4342cd-8632-4e21-8786-b894fa2aea45 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:26.973440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5f95-51a2-4673-befe-ee6c33615536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:26.974093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5f95-51a2-4673-befe-ee6c33615536 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:26.974375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5f95-51a2-4673-befe-ee6c33615536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:26.974682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5f95-51a2-4673-befe-ee6c33615536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:26.975382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5f95-51a2-4673-befe-ee6c33615536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:26.977366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac5f95-51a2-4673-befe-ee6c33615536 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:27.070876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 930/1858] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:26 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:27.076280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:27.087069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50222a-6d17-41b8-93f1-6ba05963a4af admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:27.153586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494d59-ca61-42c4-82ec-c6bd6fa8c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:27.154553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494d59-ca61-42c4-82ec-c6bd6fa8c2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:27.155042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494d59-ca61-42c4-82ec-c6bd6fa8c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:27.155386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494d59-ca61-42c4-82ec-c6bd6fa8c2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:27.156144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15494d59-ca61-42c4-82ec-c6bd6fa8c2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:27.159842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15494d59-ca61-42c4-82ec-c6bd6fa8c2a7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:27.274861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 929/1859] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:27 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:27.280708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5f95-51a2-4673-befe-ee6c33615536 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:27.291592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5f95-51a2-4673-befe-ee6c33615536 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:27.296210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d92e-02d7-4de4-bf6b-d74632a4fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:27.296875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d92e-02d7-4de4-bf6b-d74632a4fa65 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:27.297164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d92e-02d7-4de4-bf6b-d74632a4fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:27.297444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d92e-02d7-4de4-bf6b-d74632a4fa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:27.298181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0d92e-02d7-4de4-bf6b-d74632a4fa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:27.299825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0d92e-02d7-4de4-bf6b-d74632a4fa65 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:27.310158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 931/1860] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:27.314604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494d59-ca61-42c4-82ec-c6bd6fa8c2a7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:27.324479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494d59-ca61-42c4-82ec-c6bd6fa8c2a7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:27.330201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddfd18-c701-49f8-ba58-6231295d5d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:27.330899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddfd18-c701-49f8-ba58-6231295d5d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:27.331187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddfd18-c701-49f8-ba58-6231295d5d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:27.331466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddfd18-c701-49f8-ba58-6231295d5d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:27.332197 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddfd18-c701-49f8-ba58-6231295d5d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:27.333777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddfd18-c701-49f8-ba58-6231295d5d9f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:27.343422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 930/1861] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:27.349619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d92e-02d7-4de4-bf6b-d74632a4fa65 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:27.359782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d92e-02d7-4de4-bf6b-d74632a4fa65 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:27.364344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660afc6b-6984-4def-8540-3aebeca37278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:27.365541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660afc6b-6984-4def-8540-3aebeca37278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:27.365824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660afc6b-6984-4def-8540-3aebeca37278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:27.366092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660afc6b-6984-4def-8540-3aebeca37278 admin admin] PATH_INFO: `/v3/projects/26135da05ba84b88992c29c12debdf11/users/82256787dab342deb385742ecb8cfa2d/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:27.382177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660afc6b-6984-4def-8540-3aebeca37278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26135da05ba84b88992c29c12debdf11, user_id=82256787dab342deb385742ecb8cfa2d, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:27.385077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660afc6b-6984-4def-8540-3aebeca37278 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:27.458710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 932/1862] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:27 2022] PUT /identity/v3/projects/26135da05ba84b88992c29c12debdf11/users/82256787dab342deb385742ecb8cfa2d/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:27.469158 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f0f73-2b99-429d-87f1-3194a53334fd None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:27.469455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f0f73-2b99-429d-87f1-3194a53334fd None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:27.470298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f0f73-2b99-429d-87f1-3194a53334fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:27.496028 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-bd1f0f73-2b99-429d-87f1-3194a53334fd None None] MFA Rules not processed for user `82256787dab342deb385742ecb8cfa2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:27.497254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bd1f0f73-2b99-429d-87f1-3194a53334fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:27.559335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 931/1863] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:27.563927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660afc6b-6984-4def-8540-3aebeca37278 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:27.648993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660afc6b-6984-4def-8540-3aebeca37278 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:27.654674 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df33e78-3f2d-42b0-9728-65a39c00b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:27.657173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df33e78-3f2d-42b0-9728-65a39c00b7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:27.657173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df33e78-3f2d-42b0-9728-65a39c00b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:27.657173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df33e78-3f2d-42b0-9728-65a39c00b7f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:27.657173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df33e78-3f2d-42b0-9728-65a39c00b7f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:27.659398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df33e78-3f2d-42b0-9728-65a39c00b7f4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:27.774739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 933/1864] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:27 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:27.776003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f0f73-2b99-429d-87f1-3194a53334fd None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:27.787364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f0f73-2b99-429d-87f1-3194a53334fd None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:27.844649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5103-7bc5-43b7-a0c5-15d9f4b60904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:27.845334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5103-7bc5-43b7-a0c5-15d9f4b60904 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:27.845621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5103-7bc5-43b7-a0c5-15d9f4b60904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:27.845898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5103-7bc5-43b7-a0c5-15d9f4b60904 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:27.846628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b5103-7bc5-43b7-a0c5-15d9f4b60904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:27.848550 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b5103-7bc5-43b7-a0c5-15d9f4b60904 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:27.961249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 932/1865] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:27 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:27.965364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df33e78-3f2d-42b0-9728-65a39c00b7f4 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:27.975904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df33e78-3f2d-42b0-9728-65a39c00b7f4 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:27.981280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfcc33-80ef-47e8-a393-fea5bddc31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:27.982107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfcc33-80ef-47e8-a393-fea5bddc31b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:27.982324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfcc33-80ef-47e8-a393-fea5bddc31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:27.982640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfcc33-80ef-47e8-a393-fea5bddc31b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:27.983390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfcc33-80ef-47e8-a393-fea5bddc31b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:27.985003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfcc33-80ef-47e8-a393-fea5bddc31b3 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:27.997715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 934/1866] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:28.002252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5103-7bc5-43b7-a0c5-15d9f4b60904 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:28.012856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5103-7bc5-43b7-a0c5-15d9f4b60904 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:28.023999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020322eb-7466-47a4-aac1-36fa3bc2b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:28.024912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020322eb-7466-47a4-aac1-36fa3bc2b480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:28.025195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020322eb-7466-47a4-aac1-36fa3bc2b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:28.025473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020322eb-7466-47a4-aac1-36fa3bc2b480 admin admin] PATH_INFO: `/v3/projects/dc36fdb69c92458b9939bb46c52cd318/users/5227ac7105e24c82851eb0aaa0d93361/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:28.040848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020322eb-7466-47a4-aac1-36fa3bc2b480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc36fdb69c92458b9939bb46c52cd318, user_id=5227ac7105e24c82851eb0aaa0d93361, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:28.043578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020322eb-7466-47a4-aac1-36fa3bc2b480 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:28.115360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 933/1867] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:28 2022] PUT /identity/v3/projects/dc36fdb69c92458b9939bb46c52cd318/users/5227ac7105e24c82851eb0aaa0d93361/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:28.119239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfcc33-80ef-47e8-a393-fea5bddc31b3 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:28.129622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfcc33-80ef-47e8-a393-fea5bddc31b3 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:28.191295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd5a51-3974-41f8-a86d-3aac0a8bc256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:28.192142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5a51-3974-41f8-a86d-3aac0a8bc256 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:28.192537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5a51-3974-41f8-a86d-3aac0a8bc256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:28.192917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5a51-3974-41f8-a86d-3aac0a8bc256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:28.194108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd5a51-3974-41f8-a86d-3aac0a8bc256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:28.195868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd5a51-3974-41f8-a86d-3aac0a8bc256 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:28.210699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 935/1868] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:28.211605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020322eb-7466-47a4-aac1-36fa3bc2b480 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:28.227547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020322eb-7466-47a4-aac1-36fa3bc2b480 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:28.232498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:28.233456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:28.233803 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:28.234144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] PATH_INFO: `/v3/projects/dc36fdb69c92458b9939bb46c52cd318/users/5227ac7105e24c82851eb0aaa0d93361/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:28.236871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc36fdb69c92458b9939bb46c52cd318, user_id=5227ac7105e24c82851eb0aaa0d93361, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:28.239611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:28.250546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 934/1869] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:28 2022] PUT /identity/v3/projects/dc36fdb69c92458b9939bb46c52cd318/users/5227ac7105e24c82851eb0aaa0d93361/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:28.262645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3aa40-46fd-479a-9f3b-64fe60e613e2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:28.263122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3aa40-46fd-479a-9f3b-64fe60e613e2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:28.263604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3aa40-46fd-479a-9f3b-64fe60e613e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:28.293426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-9dc3aa40-46fd-479a-9f3b-64fe60e613e2 None None] MFA Rules not processed for user `5227ac7105e24c82851eb0aaa0d93361`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:28.295519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-9dc3aa40-46fd-479a-9f3b-64fe60e613e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:28.367116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 936/1870] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:28.378944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:28.380599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:28.437911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecc5a7-3927-41b3-9597-a9c851594dbd admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:28.441796 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b81f10-0b0e-4b82-a0fa-44a76c807a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:28.442452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b81f10-0b0e-4b82-a0fa-44a76c807a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:28.442769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b81f10-0b0e-4b82-a0fa-44a76c807a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:28.443049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b81f10-0b0e-4b82-a0fa-44a76c807a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:28.451946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b81f10-0b0e-4b82-a0fa-44a76c807a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:28.453371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b81f10-0b0e-4b82-a0fa-44a76c807a27 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:28.462762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 935/1871] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:29.512878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3aa40-46fd-479a-9f3b-64fe60e613e2 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:29.522776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3aa40-46fd-479a-9f3b-64fe60e613e2 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:29.527555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5227ac7105e24c82851eb0aaa0d93361', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc36fdb69c92458b9939bb46c52cd318', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:29.528248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:29.528539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:29.528823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:29.529622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:29.529936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:29.531631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:29.544710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 937/1872] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:29.550782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b81f10-0b0e-4b82-a0fa-44a76c807a27 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:29.560482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b81f10-0b0e-4b82-a0fa-44a76c807a27 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:29.565955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8c80-5743-412c-8269-081663241640 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5227ac7105e24c82851eb0aaa0d93361', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc36fdb69c92458b9939bb46c52cd318', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:29.566795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8c80-5743-412c-8269-081663241640 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:29.567156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8c80-5743-412c-8269-081663241640 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:29.567507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a8c80-5743-412c-8269-081663241640 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:29.568331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8c80-5743-412c-8269-081663241640 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:29.570337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a8c80-5743-412c-8269-081663241640 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:29.653084 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 936/1873] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:29 2022] POST /identity/v3/projects => generated 354 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:29.657183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:29.667750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4721f28-719b-4e2d-814b-cbc18899f2c4 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:29.722853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5227ac7105e24c82851eb0aaa0d93361', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc36fdb69c92458b9939bb46c52cd318', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:29.723442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:29.723728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:29.724004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:29.724727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:29.725035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:29.726714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:29.738108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 938/1874] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:29.776727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8c80-5743-412c-8269-081663241640 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:29.787592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a8c80-5743-412c-8269-081663241640 tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:29.792188 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5227ac7105e24c82851eb0aaa0d93361', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc36fdb69c92458b9939bb46c52cd318', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:29.793134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:29.793425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:29.793707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] PATH_INFO: `/v3/projects/b86a977905a7465ebdb66f4f6e83213f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:29.794933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b86a977905a7465ebdb66f4f6e83213f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:29.796825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:29.938046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86a977905a7465ebdb66f4f6e83213f', 'request_id': 'req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:29.994857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86a977905a7465ebdb66f4f6e83213f', 'request_id': 'req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:30.000609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86a977905a7465ebdb66f4f6e83213f', 'request_id': 'req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:30.011897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] The token cache is being invalidate because project b86a977905a7465ebdb66f4f6e83213f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:30.013496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:30.013496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e52b049c-0f54-4cbd-ba84-e678fbdc0d4f tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:30.014497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 937/1875] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:29 2022] DELETE /identity/v3/projects/b86a977905a7465ebdb66f4f6e83213f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:30.621111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:30.623146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:30.687146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e262-3924-4151-83c7-060ccc80c8fe tempest-VolumeQuotaClassesTest-1699237754 tempest-VolumeQuotaClassesTest-1699237754-project-admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:30.743449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:30.744345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:30.744634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:30.744917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] PATH_INFO: `/v3/users/82256787dab342deb385742ecb8cfa2d` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:30.746135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82256787dab342deb385742ecb8cfa2d)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:30.748206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:30.941137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82256787dab342deb385742ecb8cfa2d'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:30.948087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82256787dab342deb385742ecb8cfa2d'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:30.948780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82256787dab342deb385742ecb8cfa2d'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:30.949381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82256787dab342deb385742ecb8cfa2d'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:31.052042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82256787dab342deb385742ecb8cfa2d'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:31.070717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 939/1876] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:30 2022] DELETE /identity/v3/users/82256787dab342deb385742ecb8cfa2d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:31.075394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742d20-99d9-4b05-b5f5-bb3ede30a72b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:31.075904 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742d20-99d9-4b05-b5f5-bb3ede30a72b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:31.075993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742d20-99d9-4b05-b5f5-bb3ede30a72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:31.094282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-de742d20-99d9-4b05-b5f5-bb3ede30a72b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:31.095592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-de742d20-99d9-4b05-b5f5-bb3ede30a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:31.161950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 938/1877] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:31.171535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:31.173029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:31.237422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58e0cc-a929-43c7-9d72-92c3175ec630 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:31.242041 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce990a4e-3c3c-4fef-810c-18b5fe145c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:31.242924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce990a4e-3c3c-4fef-810c-18b5fe145c20 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:31.243042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce990a4e-3c3c-4fef-810c-18b5fe145c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:31.243272 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce990a4e-3c3c-4fef-810c-18b5fe145c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:31.254191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce990a4e-3c3c-4fef-810c-18b5fe145c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:31.257140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce990a4e-3c3c-4fef-810c-18b5fe145c20 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:31.266657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 940/1878] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:32.025456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de742d20-99d9-4b05-b5f5-bb3ede30a72b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:32.027525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-de742d20-99d9-4b05-b5f5-bb3ede30a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:32.044020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de742d20-99d9-4b05-b5f5-bb3ede30a72b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:32.051124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:32.052422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:32.054020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:32.054020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] PATH_INFO: `/v3/projects/26135da05ba84b88992c29c12debdf11` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:32.057192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26135da05ba84b88992c29c12debdf11)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:32.059590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:32.198727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26135da05ba84b88992c29c12debdf11', 'request_id': 'req-7095113c-65d2-41fa-aa1b-42458136ff6b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.383132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26135da05ba84b88992c29c12debdf11', 'request_id': 'req-7095113c-65d2-41fa-aa1b-42458136ff6b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.390613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26135da05ba84b88992c29c12debdf11', 'request_id': 'req-7095113c-65d2-41fa-aa1b-42458136ff6b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.402802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] The token cache is being invalidate because project 26135da05ba84b88992c29c12debdf11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:32.403403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.403929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.409490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 939/1879] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:32 2022] DELETE /identity/v3/projects/26135da05ba84b88992c29c12debdf11 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:32.411235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce990a4e-3c3c-4fef-810c-18b5fe145c20 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:32.422005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce990a4e-3c3c-4fef-810c-18b5fe145c20 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:32.491335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:32.491335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:32.491599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:32.491892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] PATH_INFO: `/v3/users/5227ac7105e24c82851eb0aaa0d93361` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:32.493285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5227ac7105e24c82851eb0aaa0d93361)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:32.495378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:32.699361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5227ac7105e24c82851eb0aaa0d93361'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.706952 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5227ac7105e24c82851eb0aaa0d93361'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.707769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5227ac7105e24c82851eb0aaa0d93361'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.708378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5227ac7105e24c82851eb0aaa0d93361'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.833830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3af61fbf-70f7-48a6-b824-eedf5fb3dc2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5227ac7105e24c82851eb0aaa0d93361'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:32.853579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 941/1880] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:32 2022] DELETE /identity/v3/users/5227ac7105e24c82851eb0aaa0d93361 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:33.350806 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:33.352398 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:33.377966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095113c-65d2-41fa-aa1b-42458136ff6b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:33.448304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:33.449960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:33.450418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:33.451541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] PATH_INFO: `/v3/projects/dc36fdb69c92458b9939bb46c52cd318` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:33.453857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc36fdb69c92458b9939bb46c52cd318)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:33.456726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:33.589648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc36fdb69c92458b9939bb46c52cd318', 'request_id': 'req-42e53934-a749-446a-9593-4ac73113a4ba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:33.674624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc36fdb69c92458b9939bb46c52cd318', 'request_id': 'req-42e53934-a749-446a-9593-4ac73113a4ba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:33.683255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc36fdb69c92458b9939bb46c52cd318', 'request_id': 'req-42e53934-a749-446a-9593-4ac73113a4ba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:33.709555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] The token cache is being invalidate because project dc36fdb69c92458b9939bb46c52cd318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:33.711937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:33.711937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42e53934-a749-446a-9593-4ac73113a4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:33.712615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 940/1881] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:33 2022] DELETE /identity/v3/projects/dc36fdb69c92458b9939bb46c52cd318 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:33.717607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bc8c-d794-406f-8359-b6e651dfca8f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:33.718088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bc8c-d794-406f-8359-b6e651dfca8f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:33.718177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072bc8c-d794-406f-8359-b6e651dfca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:33.738008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-6072bc8c-d794-406f-8359-b6e651dfca8f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:33.739367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6072bc8c-d794-406f-8359-b6e651dfca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:33.838001 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 942/1882] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:33.845444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261916c-22aa-429b-b6e6-4413d1b91ca0 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:33.845720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261916c-22aa-429b-b6e6-4413d1b91ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:33.846036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261916c-22aa-429b-b6e6-4413d1b91ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:33.866257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6261916c-22aa-429b-b6e6-4413d1b91ca0 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:33.867664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6261916c-22aa-429b-b6e6-4413d1b91ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:33.876851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 941/1883] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:33.881737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072bc8c-d794-406f-8359-b6e651dfca8f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:33.895278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072bc8c-d794-406f-8359-b6e651dfca8f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:33.901811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:33.902813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:33.903262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:33.903540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:33.904600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:33.905093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:33.908179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:33.920966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 943/1884] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:33.927908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261916c-22aa-429b-b6e6-4413d1b91ca0 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:33.941241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261916c-22aa-429b-b6e6-4413d1b91ca0 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:33.947958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefb3b9-0e24-4f54-82bb-9ba1f18714e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:33.948699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefb3b9-0e24-4f54-82bb-9ba1f18714e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:33.948990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefb3b9-0e24-4f54-82bb-9ba1f18714e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:33.949270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefb3b9-0e24-4f54-82bb-9ba1f18714e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:33.952702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefb3b9-0e24-4f54-82bb-9ba1f18714e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:33.954332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefb3b9-0e24-4f54-82bb-9ba1f18714e2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:34.071661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 942/1885] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:33 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:34.075827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:34.085705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4a1fd-5730-4f3a-b8c6-9856d0c01c73 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:34.144851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2540-6b2a-4ad0-b71a-8740f5327630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:34.145547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2540-6b2a-4ad0-b71a-8740f5327630 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:34.145835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2540-6b2a-4ad0-b71a-8740f5327630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:34.146133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2540-6b2a-4ad0-b71a-8740f5327630 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:34.146889 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be2540-6b2a-4ad0-b71a-8740f5327630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:34.149093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be2540-6b2a-4ad0-b71a-8740f5327630 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:34.292656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 944/1886] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:34 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:34.296993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefb3b9-0e24-4f54-82bb-9ba1f18714e2 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:34.308965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefb3b9-0e24-4f54-82bb-9ba1f18714e2 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:34.313909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867860b-f685-4177-ae7f-844d89bbfd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:34.314971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867860b-f685-4177-ae7f-844d89bbfd26 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:34.315404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867860b-f685-4177-ae7f-844d89bbfd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:34.315827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867860b-f685-4177-ae7f-844d89bbfd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:34.316894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867860b-f685-4177-ae7f-844d89bbfd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:34.318933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867860b-f685-4177-ae7f-844d89bbfd26 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:34.335284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2540-6b2a-4ad0-b71a-8740f5327630 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:34.348674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 943/1887] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:34.353840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2540-6b2a-4ad0-b71a-8740f5327630 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:34.359312 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0b98d-4f06-4e77-b922-91bd3f8833f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:34.360236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b98d-4f06-4e77-b922-91bd3f8833f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:34.360706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b98d-4f06-4e77-b922-91bd3f8833f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:34.361243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b98d-4f06-4e77-b922-91bd3f8833f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:34.362994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0b98d-4f06-4e77-b922-91bd3f8833f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:34.365119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0b98d-4f06-4e77-b922-91bd3f8833f3 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:34.377476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 945/1888] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:34.381099 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867860b-f685-4177-ae7f-844d89bbfd26 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:34.392076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867860b-f685-4177-ae7f-844d89bbfd26 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:34.398765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4679c-e94c-416a-851c-853f7cc96bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:34.407872 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4679c-e94c-416a-851c-853f7cc96bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:34.409077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4679c-e94c-416a-851c-853f7cc96bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:34.413386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4679c-e94c-416a-851c-853f7cc96bea admin admin] PATH_INFO: `/v3/projects/e59b7247d05d43d692c39a22d07f8b16/users/b12f868a55a74bd598a67bb7770d82c6/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:34.427622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4679c-e94c-416a-851c-853f7cc96bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59b7247d05d43d692c39a22d07f8b16, user_id=b12f868a55a74bd598a67bb7770d82c6, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:34.430798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4679c-e94c-416a-851c-853f7cc96bea admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:34.532917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 944/1889] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:34 2022] PUT /identity/v3/projects/e59b7247d05d43d692c39a22d07f8b16/users/b12f868a55a74bd598a67bb7770d82c6/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:34.543520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7807df8-6a96-4e60-9159-4bfbca12cf6d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:34.543820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7807df8-6a96-4e60-9159-4bfbca12cf6d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:34.544130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7807df8-6a96-4e60-9159-4bfbca12cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:34.578073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f7807df8-6a96-4e60-9159-4bfbca12cf6d None None] MFA Rules not processed for user `b12f868a55a74bd598a67bb7770d82c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:34.579840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f7807df8-6a96-4e60-9159-4bfbca12cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:34.670573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 946/1890] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:34.675570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4679c-e94c-416a-851c-853f7cc96bea admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:34.758558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4679c-e94c-416a-851c-853f7cc96bea admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:34.764794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bcfff-9b0c-47ba-ae17-16cfa24b3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:34.765759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bcfff-9b0c-47ba-ae17-16cfa24b3340 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:34.766439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bcfff-9b0c-47ba-ae17-16cfa24b3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:34.766850 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bcfff-9b0c-47ba-ae17-16cfa24b3340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:34.768916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bcfff-9b0c-47ba-ae17-16cfa24b3340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:34.771080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bcfff-9b0c-47ba-ae17-16cfa24b3340 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:34.876505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 945/1891] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:34 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:34.883027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7807df8-6a96-4e60-9159-4bfbca12cf6d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:34.904470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7807df8-6a96-4e60-9159-4bfbca12cf6d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:34.964349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d536-8a20-4b21-8a73-0c8a9cee7f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:34.965031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d536-8a20-4b21-8a73-0c8a9cee7f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:34.965317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d536-8a20-4b21-8a73-0c8a9cee7f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:34.965598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d536-8a20-4b21-8a73-0c8a9cee7f8e admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:34.966305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99d536-8a20-4b21-8a73-0c8a9cee7f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:34.968308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99d536-8a20-4b21-8a73-0c8a9cee7f8e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:35.104276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 947/1892] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:34 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:35.109324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bcfff-9b0c-47ba-ae17-16cfa24b3340 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:35.122362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bcfff-9b0c-47ba-ae17-16cfa24b3340 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:35.128284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8d3f9-089d-4faf-87fd-db2461dd61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:35.129055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d3f9-089d-4faf-87fd-db2461dd61eb admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:35.129322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d3f9-089d-4faf-87fd-db2461dd61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:35.129607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8d3f9-089d-4faf-87fd-db2461dd61eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:35.130437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8d3f9-089d-4faf-87fd-db2461dd61eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:35.132010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8d3f9-089d-4faf-87fd-db2461dd61eb admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:35.144795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 946/1893] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:35.149073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d536-8a20-4b21-8a73-0c8a9cee7f8e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:35.160559 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d536-8a20-4b21-8a73-0c8a9cee7f8e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:35.165967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d4036-787a-460a-a5a7-42dc669ba7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:35.166678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4036-787a-460a-a5a7-42dc669ba7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:35.166969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4036-787a-460a-a5a7-42dc669ba7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:35.167252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4036-787a-460a-a5a7-42dc669ba7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:35.169534 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d4036-787a-460a-a5a7-42dc669ba7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:35.169755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d4036-787a-460a-a5a7-42dc669ba7ce admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:35.179855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 948/1894] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:35.184214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8d3f9-089d-4faf-87fd-db2461dd61eb admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:35.195865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8d3f9-089d-4faf-87fd-db2461dd61eb admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:35.200497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa916412-7152-4d39-9aa3-bfb1ba8104da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:35.201395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa916412-7152-4d39-9aa3-bfb1ba8104da admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:35.201679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa916412-7152-4d39-9aa3-bfb1ba8104da admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:35.201964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa916412-7152-4d39-9aa3-bfb1ba8104da admin admin] PATH_INFO: `/v3/projects/ed8ca5e0ac7c494380b0a5becaf28c62/users/992a7bca9c154cfab5533f0eb19e15ea/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:35.217394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa916412-7152-4d39-9aa3-bfb1ba8104da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8ca5e0ac7c494380b0a5becaf28c62, user_id=992a7bca9c154cfab5533f0eb19e15ea, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:35.220081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa916412-7152-4d39-9aa3-bfb1ba8104da admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:35.310112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 947/1895] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:35 2022] PUT /identity/v3/projects/ed8ca5e0ac7c494380b0a5becaf28c62/users/992a7bca9c154cfab5533f0eb19e15ea/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:35.321326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd487e-794f-4c1f-9cab-2789310b9324 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:35.321548 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd487e-794f-4c1f-9cab-2789310b9324 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:35.321858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd487e-794f-4c1f-9cab-2789310b9324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:35.350873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8acd487e-794f-4c1f-9cab-2789310b9324 None None] MFA Rules not processed for user `992a7bca9c154cfab5533f0eb19e15ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:35.352128 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8acd487e-794f-4c1f-9cab-2789310b9324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:35.418090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 949/1896] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:35.422781 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa916412-7152-4d39-9aa3-bfb1ba8104da admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:35.482826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa916412-7152-4d39-9aa3-bfb1ba8104da admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:35.488173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f349c-9fd9-4ba5-a34f-ae68a0d74dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:35.488832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f349c-9fd9-4ba5-a34f-ae68a0d74dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:35.489123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f349c-9fd9-4ba5-a34f-ae68a0d74dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:35.489404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f349c-9fd9-4ba5-a34f-ae68a0d74dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:35.490104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f349c-9fd9-4ba5-a34f-ae68a0d74dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:35.492037 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f349c-9fd9-4ba5-a34f-ae68a0d74dc8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:35.590762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 948/1897] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:35 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:35.594729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd487e-794f-4c1f-9cab-2789310b9324 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:35.606382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd487e-794f-4c1f-9cab-2789310b9324 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:35.671452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ff92-bbca-4cdc-9f13-e3a26cf2b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:35.672646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ff92-bbca-4cdc-9f13-e3a26cf2b9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:35.673273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ff92-bbca-4cdc-9f13-e3a26cf2b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:35.673749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ff92-bbca-4cdc-9f13-e3a26cf2b9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:35.677421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ff92-bbca-4cdc-9f13-e3a26cf2b9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:35.681659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ff92-bbca-4cdc-9f13-e3a26cf2b9e8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:35.778815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 950/1898] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:35 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:35.782759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f349c-9fd9-4ba5-a34f-ae68a0d74dc8 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:35.797098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f349c-9fd9-4ba5-a34f-ae68a0d74dc8 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:35.804933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5812-24a2-4739-8390-f0e48804e00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:35.805728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5812-24a2-4739-8390-f0e48804e00f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:35.806013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5812-24a2-4739-8390-f0e48804e00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:35.806296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5812-24a2-4739-8390-f0e48804e00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:35.815199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f5812-24a2-4739-8390-f0e48804e00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:35.815199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f5812-24a2-4739-8390-f0e48804e00f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:35.820252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 949/1899] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:35.824422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ff92-bbca-4cdc-9f13-e3a26cf2b9e8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:35.835580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ff92-bbca-4cdc-9f13-e3a26cf2b9e8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:35.841306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dec5b-68e3-4eaa-9959-e9cac236a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:35.842142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dec5b-68e3-4eaa-9959-e9cac236a631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:35.842433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dec5b-68e3-4eaa-9959-e9cac236a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:35.842770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dec5b-68e3-4eaa-9959-e9cac236a631 admin admin] PATH_INFO: `/v3/projects/acec13c79621420c8c940b3e09114e7d/users/7f4c784aea894ad9a0283ce27f162c72/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:35.867140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dec5b-68e3-4eaa-9959-e9cac236a631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acec13c79621420c8c940b3e09114e7d, user_id=7f4c784aea894ad9a0283ce27f162c72, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:35.870371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dec5b-68e3-4eaa-9959-e9cac236a631 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:35.949630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 951/1900] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:35 2022] PUT /identity/v3/projects/acec13c79621420c8c940b3e09114e7d/users/7f4c784aea894ad9a0283ce27f162c72/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:35.953878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5812-24a2-4739-8390-f0e48804e00f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:35.964370 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5812-24a2-4739-8390-f0e48804e00f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:36.057047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d94171-c8a5-4243-9280-791ffa5dff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:36.057729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94171-c8a5-4243-9280-791ffa5dff7a admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:36.058014 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94171-c8a5-4243-9280-791ffa5dff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:36.058291 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94171-c8a5-4243-9280-791ffa5dff7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:36.059129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d94171-c8a5-4243-9280-791ffa5dff7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:36.060753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d94171-c8a5-4243-9280-791ffa5dff7a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:36.071967 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 950/1901] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:36.077089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dec5b-68e3-4eaa-9959-e9cac236a631 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:36.087525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dec5b-68e3-4eaa-9959-e9cac236a631 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:36.092314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:36.093133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:36.093420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:36.093738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] PATH_INFO: `/v3/projects/acec13c79621420c8c940b3e09114e7d/users/7f4c784aea894ad9a0283ce27f162c72/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:36.096230 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acec13c79621420c8c940b3e09114e7d, user_id=7f4c784aea894ad9a0283ce27f162c72, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:36.099028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:36.109622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 952/1902] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:36 2022] PUT /identity/v3/projects/acec13c79621420c8c940b3e09114e7d/users/7f4c784aea894ad9a0283ce27f162c72/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:36.119850 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482018-0137-4e4d-9fde-0013889527bf None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:36.120145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482018-0137-4e4d-9fde-0013889527bf None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:36.120427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482018-0137-4e4d-9fde-0013889527bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:36.143489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:36.146387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:36.152829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-05482018-0137-4e4d-9fde-0013889527bf None None] MFA Rules not processed for user `7f4c784aea894ad9a0283ce27f162c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:36.154523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-05482018-0137-4e4d-9fde-0013889527bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:36.227877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c6a0-1383-4adc-88db-62e379212b80 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:36.234047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:36.235203 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:36.235677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:36.236056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] PATH_INFO: `/v3/users/3984bffff3ff4755a88611b5bd4d209b` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:36.238877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3984bffff3ff4755a88611b5bd4d209b)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:36.243115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:36.247415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 951/1903] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:36.263093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05482018-0137-4e4d-9fde-0013889527bf None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:36.264525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-05482018-0137-4e4d-9fde-0013889527bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:36.349626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05482018-0137-4e4d-9fde-0013889527bf None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:36.367060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c30926-422a-4e90-a8df-e3b7121b6203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:36.368102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c30926-422a-4e90-a8df-e3b7121b6203 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:36.368607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c30926-422a-4e90-a8df-e3b7121b6203 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:36.369115 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c30926-422a-4e90-a8df-e3b7121b6203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:36.385056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c30926-422a-4e90-a8df-e3b7121b6203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:36.386504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c30926-422a-4e90-a8df-e3b7121b6203 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:36.397047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 952/1904] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:36.421645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3984bffff3ff4755a88611b5bd4d209b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:36.429751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3984bffff3ff4755a88611b5bd4d209b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:36.431085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3984bffff3ff4755a88611b5bd4d209b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:36.431781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3984bffff3ff4755a88611b5bd4d209b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:36.490736 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d7e3babb-03c3-4a48-a46e-1e296f85df0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3984bffff3ff4755a88611b5bd4d209b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:36.514477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c30926-422a-4e90-a8df-e3b7121b6203 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:36.522025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 953/1905] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:36 2022] DELETE /identity/v3/users/3984bffff3ff4755a88611b5bd4d209b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:36.523681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c30926-422a-4e90-a8df-e3b7121b6203 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:36.527226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7f52-6fd0-4e1b-968e-5cf19ec675e4 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:36.528458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7f52-6fd0-4e1b-968e-5cf19ec675e4 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:36.528742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7f52-6fd0-4e1b-968e-5cf19ec675e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:36.566883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-328b7f52-6fd0-4e1b-968e-5cf19ec675e4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:36.568177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-328b7f52-6fd0-4e1b-968e-5cf19ec675e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:36.604289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:36.606075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:36.607004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:36.607732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:36.609990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:36.642334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 954/1906] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:36.652761 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7f52-6fd0-4e1b-968e-5cf19ec675e4 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:36.654911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-328b7f52-6fd0-4e1b-968e-5cf19ec675e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:36.700139 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:36.703425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:36.722481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 953/1907] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:36.760399 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7f52-6fd0-4e1b-968e-5cf19ec675e4 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:36.766360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde282d7-872f-410a-bfcb-b8d9ba717c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:36.767306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde282d7-872f-410a-bfcb-b8d9ba717c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:36.768266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde282d7-872f-410a-bfcb-b8d9ba717c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:36.768636 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde282d7-872f-410a-bfcb-b8d9ba717c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:36.780884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde282d7-872f-410a-bfcb-b8d9ba717c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:36.783331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde282d7-872f-410a-bfcb-b8d9ba717c1f service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:36.797023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 955/1908] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:37.387852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:37.389214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:37.409027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09c5d-6c4c-428f-88dd-0648a5b0ca96 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:37.422660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:37.424640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:37.425250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:37.425696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] PATH_INFO: `/v3/projects/e1a30b63d07d4315b884e962f31f2e36` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:37.428567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a30b63d07d4315b884e962f31f2e36)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:37.431320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:37.573994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a30b63d07d4315b884e962f31f2e36', 'request_id': 'req-adcb3924-47dc-43c1-823c-b3c991715ba6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:37.765925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a30b63d07d4315b884e962f31f2e36', 'request_id': 'req-adcb3924-47dc-43c1-823c-b3c991715ba6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:37.774574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a30b63d07d4315b884e962f31f2e36', 'request_id': 'req-adcb3924-47dc-43c1-823c-b3c991715ba6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:37.808752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] The token cache is being invalidate because project e1a30b63d07d4315b884e962f31f2e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:37.809072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:37.812672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-adcb3924-47dc-43c1-823c-b3c991715ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:37.814419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 954/1909] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:37 2022] DELETE /identity/v3/projects/e1a30b63d07d4315b884e962f31f2e36 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:37.820050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196da13-a5dc-449b-93ea-52dc23aebe18 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:37.820576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196da13-a5dc-449b-93ea-52dc23aebe18 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:37.820653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196da13-a5dc-449b-93ea-52dc23aebe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:37.842397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1196da13-a5dc-449b-93ea-52dc23aebe18 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:37.843558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1196da13-a5dc-449b-93ea-52dc23aebe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:37.931129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 956/1910] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:37.940828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c0c8-642a-4979-9403-b71694206704 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:37.941191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c0c8-642a-4979-9403-b71694206704 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:37.941609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c0c8-642a-4979-9403-b71694206704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:37.962933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7155c0c8-642a-4979-9403-b71694206704 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:37.964080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7155c0c8-642a-4979-9403-b71694206704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:37.972638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 955/1911] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:37.977036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196da13-a5dc-449b-93ea-52dc23aebe18 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:37.987140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196da13-a5dc-449b-93ea-52dc23aebe18 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:37.991870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:37.992527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:37.993140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:37.993285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:37.993948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:37.994309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:37.996019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:38.008732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 957/1912] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:38.013327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155c0c8-642a-4979-9403-b71694206704 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:38.023811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155c0c8-642a-4979-9403-b71694206704 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:38.030981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cacd19-4d67-4e43-a375-de9d513c76f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:38.031849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cacd19-4d67-4e43-a375-de9d513c76f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:38.032834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cacd19-4d67-4e43-a375-de9d513c76f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:38.033819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cacd19-4d67-4e43-a375-de9d513c76f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:38.034890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cacd19-4d67-4e43-a375-de9d513c76f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:38.037414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cacd19-4d67-4e43-a375-de9d513c76f0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:38.138650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 956/1913] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:38 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:38.139833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:38.151729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f543bd-c8fa-4f5f-9904-a8a1d0f6ca8f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:38.241922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1008b-d319-42ec-ba62-fd609ab8f209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:38.241922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1008b-d319-42ec-ba62-fd609ab8f209 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:38.241922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1008b-d319-42ec-ba62-fd609ab8f209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:38.241922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1008b-d319-42ec-ba62-fd609ab8f209 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:38.242265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1008b-d319-42ec-ba62-fd609ab8f209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:38.242265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1008b-d319-42ec-ba62-fd609ab8f209 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:38.378301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 958/1914] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:38 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:38.388018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cacd19-4d67-4e43-a375-de9d513c76f0 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:38.401833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cacd19-4d67-4e43-a375-de9d513c76f0 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:38.410583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3afad-2554-48c1-9e1e-38138da843bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:38.411336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3afad-2554-48c1-9e1e-38138da843bb admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:38.411630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3afad-2554-48c1-9e1e-38138da843bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:38.416843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3afad-2554-48c1-9e1e-38138da843bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:38.416843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3afad-2554-48c1-9e1e-38138da843bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:38.416843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3afad-2554-48c1-9e1e-38138da843bb admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:38.432643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 957/1915] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:38.432791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1008b-d319-42ec-ba62-fd609ab8f209 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:38.444812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1008b-d319-42ec-ba62-fd609ab8f209 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:38.453671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523f5e5-b30f-4b37-9933-2027dcd7ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:38.454352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523f5e5-b30f-4b37-9933-2027dcd7ac74 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:38.454677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523f5e5-b30f-4b37-9933-2027dcd7ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:38.454968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523f5e5-b30f-4b37-9933-2027dcd7ac74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:38.456296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523f5e5-b30f-4b37-9933-2027dcd7ac74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:38.457929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523f5e5-b30f-4b37-9933-2027dcd7ac74 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:38.471561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 959/1916] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:38.474679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3afad-2554-48c1-9e1e-38138da843bb admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:38.485527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3afad-2554-48c1-9e1e-38138da843bb admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:38.490589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e23e7-cf2b-484e-8857-8fd2d9197a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:38.491707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e23e7-cf2b-484e-8857-8fd2d9197a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:38.492246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e23e7-cf2b-484e-8857-8fd2d9197a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:38.492613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e23e7-cf2b-484e-8857-8fd2d9197a8a admin admin] PATH_INFO: `/v3/projects/c3b725dbc9f04d5cacbbcae2d7996f60/users/d05f1793893d417080728916423a50d1/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:38.511000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e23e7-cf2b-484e-8857-8fd2d9197a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b725dbc9f04d5cacbbcae2d7996f60, user_id=d05f1793893d417080728916423a50d1, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:38.515404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e23e7-cf2b-484e-8857-8fd2d9197a8a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:38.600694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 958/1917] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:38 2022] PUT /identity/v3/projects/c3b725dbc9f04d5cacbbcae2d7996f60/users/d05f1793893d417080728916423a50d1/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:38.611446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f565-2fa6-46be-8a62-3cbd2d0aa5b3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:38.611743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f565-2fa6-46be-8a62-3cbd2d0aa5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:38.612052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7f565-2fa6-46be-8a62-3cbd2d0aa5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:38.638934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a3f7f565-2fa6-46be-8a62-3cbd2d0aa5b3 None None] MFA Rules not processed for user `d05f1793893d417080728916423a50d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:38.640516 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a3f7f565-2fa6-46be-8a62-3cbd2d0aa5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:38.713008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 960/1918] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:38.717910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e23e7-cf2b-484e-8857-8fd2d9197a8a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:38.785464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e23e7-cf2b-484e-8857-8fd2d9197a8a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:38.790613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f17a9-e3d3-4c8e-8709-abb4dd25e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:38.791454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f17a9-e3d3-4c8e-8709-abb4dd25e114 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:38.791793 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f17a9-e3d3-4c8e-8709-abb4dd25e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:38.792164 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f17a9-e3d3-4c8e-8709-abb4dd25e114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:38.793019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f17a9-e3d3-4c8e-8709-abb4dd25e114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:38.795087 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f17a9-e3d3-4c8e-8709-abb4dd25e114 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:38.910710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 959/1919] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:38 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:38.914037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7f565-2fa6-46be-8a62-3cbd2d0aa5b3 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:38.927264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7f565-2fa6-46be-8a62-3cbd2d0aa5b3 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:39.011323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447de9-f881-4fa1-a81e-ecca093f8535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:39.012014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447de9-f881-4fa1-a81e-ecca093f8535 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.012310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447de9-f881-4fa1-a81e-ecca093f8535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.012593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447de9-f881-4fa1-a81e-ecca093f8535 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.013298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447de9-f881-4fa1-a81e-ecca093f8535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:39.015285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447de9-f881-4fa1-a81e-ecca093f8535 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:39.092155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 961/1920] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:38 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:39.096275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f17a9-e3d3-4c8e-8709-abb4dd25e114 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:39.106459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f17a9-e3d3-4c8e-8709-abb4dd25e114 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:39.111485 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af9841-32c2-4eb7-b8c8-fcb46c51ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:39.112175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af9841-32c2-4eb7-b8c8-fcb46c51ea06 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.112465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af9841-32c2-4eb7-b8c8-fcb46c51ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.112749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af9841-32c2-4eb7-b8c8-fcb46c51ea06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.115574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af9841-32c2-4eb7-b8c8-fcb46c51ea06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:39.115574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af9841-32c2-4eb7-b8c8-fcb46c51ea06 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:39.126243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 960/1921] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:39.130870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447de9-f881-4fa1-a81e-ecca093f8535 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:39.140928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447de9-f881-4fa1-a81e-ecca093f8535 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:39.147702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f4499-cb34-456c-997a-5dd2adb8e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:39.148376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4499-cb34-456c-997a-5dd2adb8e36a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.148664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4499-cb34-456c-997a-5dd2adb8e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.150850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f4499-cb34-456c-997a-5dd2adb8e36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.150850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f4499-cb34-456c-997a-5dd2adb8e36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:39.151423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f4499-cb34-456c-997a-5dd2adb8e36a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:39.162034 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 962/1922] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:39.166279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af9841-32c2-4eb7-b8c8-fcb46c51ea06 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:39.177229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af9841-32c2-4eb7-b8c8-fcb46c51ea06 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:39.183382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c121-4d3b-48c6-adcf-0a56ef90bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:39.184306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c121-4d3b-48c6-adcf-0a56ef90bdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.184650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c121-4d3b-48c6-adcf-0a56ef90bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.184929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c121-4d3b-48c6-adcf-0a56ef90bdd6 admin admin] PATH_INFO: `/v3/projects/10096d6e8e84412888ed4b9a448b3a3c/users/2b52227d04fb473d8eaa3e71068abc87/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.209785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c121-4d3b-48c6-adcf-0a56ef90bdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10096d6e8e84412888ed4b9a448b3a3c, user_id=2b52227d04fb473d8eaa3e71068abc87, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:39.212500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c121-4d3b-48c6-adcf-0a56ef90bdd6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:39.264104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 961/1923] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:39 2022] PUT /identity/v3/projects/10096d6e8e84412888ed4b9a448b3a3c/users/2b52227d04fb473d8eaa3e71068abc87/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:39.275759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5e241-6788-4e01-847a-b4941851ac42 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.276067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5e241-6788-4e01-847a-b4941851ac42 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.276697 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5e241-6788-4e01-847a-b4941851ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.304906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e6e5e241-6788-4e01-847a-b4941851ac42 None None] MFA Rules not processed for user `2b52227d04fb473d8eaa3e71068abc87`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:39.306231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e6e5e241-6788-4e01-847a-b4941851ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:39.393986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 963/1924] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:39.398629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c121-4d3b-48c6-adcf-0a56ef90bdd6 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:39.491153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c121-4d3b-48c6-adcf-0a56ef90bdd6 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:39.498310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24b8c2-b326-41df-aa07-57e8a1525e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:39.499936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b8c2-b326-41df-aa07-57e8a1525e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.500463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b8c2-b326-41df-aa07-57e8a1525e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.500933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24b8c2-b326-41df-aa07-57e8a1525e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.502721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24b8c2-b326-41df-aa07-57e8a1525e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:39.505096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24b8c2-b326-41df-aa07-57e8a1525e59 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:39.584959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 962/1925] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:39 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:39.592366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5e241-6788-4e01-847a-b4941851ac42 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:39.603383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5e241-6788-4e01-847a-b4941851ac42 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:39.661848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c2c9b-326e-41f0-b51a-e5efb2f4adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:39.662528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2c9b-326e-41f0-b51a-e5efb2f4adbc admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.662843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2c9b-326e-41f0-b51a-e5efb2f4adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.663123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2c9b-326e-41f0-b51a-e5efb2f4adbc admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.663818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c2c9b-326e-41f0-b51a-e5efb2f4adbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:39.665763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c2c9b-326e-41f0-b51a-e5efb2f4adbc admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:39.763735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 964/1926] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:39 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:39.765155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24b8c2-b326-41df-aa07-57e8a1525e59 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:39.777172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24b8c2-b326-41df-aa07-57e8a1525e59 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:39.785447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dea9b-78ca-469b-a677-54b28cf08e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:39.786394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dea9b-78ca-469b-a677-54b28cf08e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.786719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dea9b-78ca-469b-a677-54b28cf08e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.786997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dea9b-78ca-469b-a677-54b28cf08e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.788080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dea9b-78ca-469b-a677-54b28cf08e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:39.790467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dea9b-78ca-469b-a677-54b28cf08e7f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:39.803810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 963/1927] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:39.808470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c2c9b-326e-41f0-b51a-e5efb2f4adbc admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:39.818605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c2c9b-326e-41f0-b51a-e5efb2f4adbc admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:39.823760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b47f7-088b-411c-9e1d-3d5362d0d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:39.824895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b47f7-088b-411c-9e1d-3d5362d0d03c admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:39.825018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b47f7-088b-411c-9e1d-3d5362d0d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:39.825345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b47f7-088b-411c-9e1d-3d5362d0d03c admin admin] PATH_INFO: `/v3/projects/2a9c80705dc542d0b28daa5e69d2bf81/users/0f27bcdfa70e4c7698e41e266f8d0c9c/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:39.841560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b47f7-088b-411c-9e1d-3d5362d0d03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9c80705dc542d0b28daa5e69d2bf81, user_id=0f27bcdfa70e4c7698e41e266f8d0c9c, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:39.844659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b47f7-088b-411c-9e1d-3d5362d0d03c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:39.919799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 965/1928] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:39 2022] PUT /identity/v3/projects/2a9c80705dc542d0b28daa5e69d2bf81/users/0f27bcdfa70e4c7698e41e266f8d0c9c/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:39.923866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dea9b-78ca-469b-a677-54b28cf08e7f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:39.934458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dea9b-78ca-469b-a677-54b28cf08e7f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:40.006015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa3dec-263f-4488-bb29-8b3ab19957df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:40.006739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3dec-263f-4488-bb29-8b3ab19957df admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:40.007032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3dec-263f-4488-bb29-8b3ab19957df admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:40.007326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3dec-263f-4488-bb29-8b3ab19957df admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:40.008648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa3dec-263f-4488-bb29-8b3ab19957df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:40.010496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa3dec-263f-4488-bb29-8b3ab19957df admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:40.025458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 964/1929] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:40.026924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b47f7-088b-411c-9e1d-3d5362d0d03c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:40.038480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b47f7-088b-411c-9e1d-3d5362d0d03c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:40.043502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:40.044403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:40.044687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:40.045137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] PATH_INFO: `/v3/projects/2a9c80705dc542d0b28daa5e69d2bf81/users/0f27bcdfa70e4c7698e41e266f8d0c9c/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:40.047168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9c80705dc542d0b28daa5e69d2bf81, user_id=0f27bcdfa70e4c7698e41e266f8d0c9c, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:40.049913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:40.061720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 966/1930] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:40 2022] PUT /identity/v3/projects/2a9c80705dc542d0b28daa5e69d2bf81/users/0f27bcdfa70e4c7698e41e266f8d0c9c/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:40.071999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b7f6-3cf7-4715-bd00-76ad05a53303 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:40.072394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b7f6-3cf7-4715-bd00-76ad05a53303 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:40.072750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12b7f6-3cf7-4715-bd00-76ad05a53303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:40.106093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3d12b7f6-3cf7-4715-bd00-76ad05a53303 None None] MFA Rules not processed for user `0f27bcdfa70e4c7698e41e266f8d0c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:40.107474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3d12b7f6-3cf7-4715-bd00-76ad05a53303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:40.181386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 965/1931] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:40.193456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:40.196050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:40.262174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50d88d-7da9-45dc-b5b8-d45cee8d778a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:40.265871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc873a-8924-4cff-a7b6-72c2bea12722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:40.266605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc873a-8924-4cff-a7b6-72c2bea12722 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:40.266908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc873a-8924-4cff-a7b6-72c2bea12722 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:40.267183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc873a-8924-4cff-a7b6-72c2bea12722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:40.326222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc873a-8924-4cff-a7b6-72c2bea12722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:40.328217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc873a-8924-4cff-a7b6-72c2bea12722 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:40.338665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 967/1932] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:43.080320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b7f6-3cf7-4715-bd00-76ad05a53303 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:43.082453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3d12b7f6-3cf7-4715-bd00-76ad05a53303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:43.258708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12b7f6-3cf7-4715-bd00-76ad05a53303 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:43.264331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:43.265959 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:43.266722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:43.267086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] PATH_INFO: `/v3/users/b12f868a55a74bd598a67bb7770d82c6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:43.268634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12f868a55a74bd598a67bb7770d82c6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:43.272784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:43.495953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12f868a55a74bd598a67bb7770d82c6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:43.496852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12f868a55a74bd598a67bb7770d82c6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:43.505039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12f868a55a74bd598a67bb7770d82c6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:43.505751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12f868a55a74bd598a67bb7770d82c6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:43.594145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12f868a55a74bd598a67bb7770d82c6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:43.625474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 966/1933] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:43 2022] DELETE /identity/v3/users/b12f868a55a74bd598a67bb7770d82c6 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:43.630330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536af64-0f15-4fdd-8875-b21786b4ce56 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:43.630863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536af64-0f15-4fdd-8875-b21786b4ce56 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:43.630938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536af64-0f15-4fdd-8875-b21786b4ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:43.653465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-5536af64-0f15-4fdd-8875-b21786b4ce56 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:43.655009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5536af64-0f15-4fdd-8875-b21786b4ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:43.740221 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 968/1934] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:43.744618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:43.746870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:43.752013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536af64-0f15-4fdd-8875-b21786b4ce56 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:43.764601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5536af64-0f15-4fdd-8875-b21786b4ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:43.834393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c320889-0ae9-4689-84b4-48dbee2c4a23 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:43.838800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:43.846237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:43.846237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:43.846237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:43.846237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:43.846856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536af64-0f15-4fdd-8875-b21786b4ce56 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:43.848100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:43.849163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:43.849650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:43.849950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:43.861827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:43.863307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:43.877336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 969/1935] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:43.911986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:43.913608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:43.924146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 967/1936] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:44.316448 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:44.317986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:44.332745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a9f2f-a9ea-4439-a4d7-6c92e20568b9 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:44.338064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:44.339138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:44.339429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:44.339830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] PATH_INFO: `/v3/projects/e59b7247d05d43d692c39a22d07f8b16` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:44.341167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59b7247d05d43d692c39a22d07f8b16)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:44.343276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:44.462594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59b7247d05d43d692c39a22d07f8b16', 'request_id': 'req-26d15c72-8074-4e18-93fe-2761472bc057'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:44.541912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59b7247d05d43d692c39a22d07f8b16', 'request_id': 'req-26d15c72-8074-4e18-93fe-2761472bc057'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:44.548037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59b7247d05d43d692c39a22d07f8b16', 'request_id': 'req-26d15c72-8074-4e18-93fe-2761472bc057'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:44.560194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] The token cache is being invalidate because project e59b7247d05d43d692c39a22d07f8b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:44.560483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:44.561131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:44.562718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 970/1937] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:44 2022] DELETE /identity/v3/projects/e59b7247d05d43d692c39a22d07f8b16 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:44.567317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:44.577970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd742f5-c0af-4e74-9287-ee594e2a1a4d service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:44.636438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:44.637226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:44.637567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:44.637882 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] PATH_INFO: `/v3/users/992a7bca9c154cfab5533f0eb19e15ea` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:44.639168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=992a7bca9c154cfab5533f0eb19e15ea)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:44.654930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:45.090791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992a7bca9c154cfab5533f0eb19e15ea'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:45.091721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992a7bca9c154cfab5533f0eb19e15ea'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:45.100546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992a7bca9c154cfab5533f0eb19e15ea'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:45.101192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992a7bca9c154cfab5533f0eb19e15ea'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:45.206134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992a7bca9c154cfab5533f0eb19e15ea'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:45.228221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 968/1938] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:44 2022] DELETE /identity/v3/users/992a7bca9c154cfab5533f0eb19e15ea => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:45.669644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:45.673350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:45.687342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d15c72-8074-4e18-93fe-2761472bc057 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:45.755711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:45.756586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:45.756875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:45.757154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] PATH_INFO: `/v3/projects/ed8ca5e0ac7c494380b0a5becaf28c62` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:45.758449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8ca5e0ac7c494380b0a5becaf28c62)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:45.760419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:45.938104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:45.940201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:45.943314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8ca5e0ac7c494380b0a5becaf28c62', 'request_id': 'req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:45.997349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa68c4-470a-4e60-aca3-ea6ea219ded2 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:46.005345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8ca5e0ac7c494380b0a5becaf28c62', 'request_id': 'req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.011348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8ca5e0ac7c494380b0a5becaf28c62', 'request_id': 'req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.024261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] The token cache is being invalidate because project ed8ca5e0ac7c494380b0a5becaf28c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:46.024768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.025507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.027974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 971/1939] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:45 2022] DELETE /identity/v3/projects/ed8ca5e0ac7c494380b0a5becaf28c62 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:46.032881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:46.035093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:46.056529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:46.057525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:46.057830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:46.058119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:46.060049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:46.113682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e562-b1e7-4b99-9a4d-0209e0e66909 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:46.121947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:46.122844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:46.123155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:46.123561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] PATH_INFO: `/v3/users/7f4c784aea894ad9a0283ce27f162c72` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:46.124948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4c784aea894ad9a0283ce27f162c72)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:46.127945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:46.155395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:46.157601 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:46.171416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 969/1940] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:46.368136 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4c784aea894ad9a0283ce27f162c72'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.374914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4c784aea894ad9a0283ce27f162c72'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.375580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4c784aea894ad9a0283ce27f162c72'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.376172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4c784aea894ad9a0283ce27f162c72'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.445502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4c784aea894ad9a0283ce27f162c72'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:46.464659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 972/1941] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:46 2022] DELETE /identity/v3/users/7f4c784aea894ad9a0283ce27f162c72 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:46.869735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:46.881450 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06a470-a185-4644-a2ff-9094c8c197ae service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:46.941948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:46.942855 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:46.943141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:46.943423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] PATH_INFO: `/v3/projects/acec13c79621420c8c940b3e09114e7d` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:46.944764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acec13c79621420c8c940b3e09114e7d)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:46.946716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.068309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acec13c79621420c8c940b3e09114e7d', 'request_id': 'req-64da6571-f3a8-4381-8921-e89d3e9c6564'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.133547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:47.134999 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:47.148634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a849-bd90-410d-9785-ab3404e3ccc7 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:47.203176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:47.204080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.204316 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.204592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] PATH_INFO: `/v3/users/d117fee119c3498d81ea2f6c29f6bad6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.206414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d117fee119c3498d81ea2f6c29f6bad6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:47.208396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.228588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acec13c79621420c8c940b3e09114e7d', 'request_id': 'req-64da6571-f3a8-4381-8921-e89d3e9c6564'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.234929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acec13c79621420c8c940b3e09114e7d', 'request_id': 'req-64da6571-f3a8-4381-8921-e89d3e9c6564'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.246102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] The token cache is being invalidate because project acec13c79621420c8c940b3e09114e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:47.246512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.247337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-64da6571-f3a8-4381-8921-e89d3e9c6564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.248985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 970/1942] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:46 2022] DELETE /identity/v3/projects/acec13c79621420c8c940b3e09114e7d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:47.255317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173e2b2-95bf-4e85-ade4-de5cccff128f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.255760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173e2b2-95bf-4e85-ade4-de5cccff128f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.256122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173e2b2-95bf-4e85-ade4-de5cccff128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.275100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6173e2b2-95bf-4e85-ade4-de5cccff128f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:47.276382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6173e2b2-95bf-4e85-ade4-de5cccff128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:47.284964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 971/1943] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:47.293151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77436d-bd0f-4171-bf3b-2257d935dec1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.293444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77436d-bd0f-4171-bf3b-2257d935dec1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.293724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77436d-bd0f-4171-bf3b-2257d935dec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.311664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ee77436d-bd0f-4171-bf3b-2257d935dec1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:47.312896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ee77436d-bd0f-4171-bf3b-2257d935dec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:47.323190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 972/1944] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:47.327260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77436d-bd0f-4171-bf3b-2257d935dec1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:47.336990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77436d-bd0f-4171-bf3b-2257d935dec1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:47.341878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:47.342565 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.342844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.343268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.344248 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:47.344752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:47.346564 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.358090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 973/1945] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:39:47.362606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:47.372508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e22bd-1ac7-4b53-a187-195d988109b8 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:47.377617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:47.381925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.381925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.381925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.381925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:47.381925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.418226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd117fee119c3498d81ea2f6c29f6bad6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.425850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd117fee119c3498d81ea2f6c29f6bad6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.426565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd117fee119c3498d81ea2f6c29f6bad6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.427278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd117fee119c3498d81ea2f6c29f6bad6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.472116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 974/1946] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:47 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:47.480748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:47.482946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:47.491503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-640cbbf7-6b3e-43f6-b80a-8da730b32554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd117fee119c3498d81ea2f6c29f6bad6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:47.513701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 973/1947] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:47 2022] DELETE /identity/v3/users/d117fee119c3498d81ea2f6c29f6bad6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:47.519000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d5332-1fb3-4e23-8c61-95d8795db8be None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.519495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d5332-1fb3-4e23-8c61-95d8795db8be None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.519937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d5332-1fb3-4e23-8c61-95d8795db8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.539403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-365d5332-1fb3-4e23-8c61-95d8795db8be None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:47.540807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-365d5332-1fb3-4e23-8c61-95d8795db8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:47.574513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dd1b2-0651-4d5c-94ca-f4b43c9cede1 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:47.616677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 974/1948] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:47.630655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d5332-1fb3-4e23-8c61-95d8795db8be None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:47.632650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-365d5332-1fb3-4e23-8c61-95d8795db8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:47.640014 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437e1d1-1cc7-42e5-894b-90cc8ee9fddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:47.640863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437e1d1-1cc7-42e5-894b-90cc8ee9fddd admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.641214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437e1d1-1cc7-42e5-894b-90cc8ee9fddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.641563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437e1d1-1cc7-42e5-894b-90cc8ee9fddd admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.642362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437e1d1-1cc7-42e5-894b-90cc8ee9fddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:47.644991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437e1d1-1cc7-42e5-894b-90cc8ee9fddd admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.697457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d5332-1fb3-4e23-8c61-95d8795db8be None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:47.701302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718d400-ba0c-49ce-b181-3d4a286492a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:47.701981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d400-ba0c-49ce-b181-3d4a286492a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.702264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d400-ba0c-49ce-b181-3d4a286492a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.702562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d400-ba0c-49ce-b181-3d4a286492a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.711892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d400-ba0c-49ce-b181-3d4a286492a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:47.713341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d400-ba0c-49ce-b181-3d4a286492a9 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.723273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 975/1949] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:47.746591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 975/1950] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:47 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:47.748850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718d400-ba0c-49ce-b181-3d4a286492a9 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:47.759410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718d400-ba0c-49ce-b181-3d4a286492a9 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:47.764543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3da6f-f8b6-410d-b64d-b288e502a3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:47.770901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3da6f-f8b6-410d-b64d-b288e502a3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.770901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3da6f-f8b6-410d-b64d-b288e502a3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.770901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3da6f-f8b6-410d-b64d-b288e502a3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.770901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3da6f-f8b6-410d-b64d-b288e502a3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:47.770901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3da6f-f8b6-410d-b64d-b288e502a3eb admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.778369 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 976/1951] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:47.783700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437e1d1-1cc7-42e5-894b-90cc8ee9fddd admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:47.794181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437e1d1-1cc7-42e5-894b-90cc8ee9fddd admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:47.799715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106415-a98b-42d6-821c-c8e74b58edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:47.800390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106415-a98b-42d6-821c-c8e74b58edc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.800690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106415-a98b-42d6-821c-c8e74b58edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.800951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106415-a98b-42d6-821c-c8e74b58edc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.801687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd106415-a98b-42d6-821c-c8e74b58edc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:47.803331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd106415-a98b-42d6-821c-c8e74b58edc1 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.813723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 976/1952] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:47.818145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3da6f-f8b6-410d-b64d-b288e502a3eb admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:47.828738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3da6f-f8b6-410d-b64d-b288e502a3eb admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:47.833647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcb3e5-a093-4b41-bb8d-ff80e6b6bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:47.834840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb3e5-a093-4b41-bb8d-ff80e6b6bfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.835126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb3e5-a093-4b41-bb8d-ff80e6b6bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.835584 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcb3e5-a093-4b41-bb8d-ff80e6b6bfc1 admin admin] PATH_INFO: `/v3/projects/e1e02efa66c444578517a22a71b0c6ae/users/da7d46674360478094aac0bb378819e4/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.851847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcb3e5-a093-4b41-bb8d-ff80e6b6bfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e02efa66c444578517a22a71b0c6ae, user_id=da7d46674360478094aac0bb378819e4, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:47.857058 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcb3e5-a093-4b41-bb8d-ff80e6b6bfc1 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:47.932772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 977/1953] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:47 2022] PUT /identity/v3/projects/e1e02efa66c444578517a22a71b0c6ae/users/da7d46674360478094aac0bb378819e4/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:47.948235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b7ae-3dd9-44e6-b644-b262bddc2242 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:47.948739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b7ae-3dd9-44e6-b644-b262bddc2242 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:47.948838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b7ae-3dd9-44e6-b644-b262bddc2242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:47.976190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-2928b7ae-3dd9-44e6-b644-b262bddc2242 None None] MFA Rules not processed for user `da7d46674360478094aac0bb378819e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:47.977492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2928b7ae-3dd9-44e6-b644-b262bddc2242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:48.065607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 977/1954] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:48.070397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcb3e5-a093-4b41-bb8d-ff80e6b6bfc1 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:48.179913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcb3e5-a093-4b41-bb8d-ff80e6b6bfc1 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:48.184704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f2056-c6b5-4036-b8ee-972f72f29e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:48.185382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f2056-c6b5-4036-b8ee-972f72f29e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.185647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f2056-c6b5-4036-b8ee-972f72f29e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.185941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f2056-c6b5-4036-b8ee-972f72f29e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.186678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f2056-c6b5-4036-b8ee-972f72f29e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:48.188629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f2056-c6b5-4036-b8ee-972f72f29e7f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:48.254174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928b7ae-3dd9-44e6-b644-b262bddc2242 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:48.254174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2928b7ae-3dd9-44e6-b644-b262bddc2242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:48.270873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928b7ae-3dd9-44e6-b644-b262bddc2242 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:48.276374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:48.277349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.277701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.278047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] PATH_INFO: `/v3/projects/ff3914a15ff3432baec432bf7f677b55` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.279434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3914a15ff3432baec432bf7f677b55)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:48.281759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:48.282418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 978/1955] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:48 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:48.286948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f2056-c6b5-4036-b8ee-972f72f29e7f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:48.358165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f2056-c6b5-4036-b8ee-972f72f29e7f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:48.362940 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158975d9-2426-4f75-a87f-2702cfe83b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:48.363915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158975d9-2426-4f75-a87f-2702cfe83b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.364208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158975d9-2426-4f75-a87f-2702cfe83b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.364530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158975d9-2426-4f75-a87f-2702cfe83b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.365185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158975d9-2426-4f75-a87f-2702cfe83b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:48.367169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158975d9-2426-4f75-a87f-2702cfe83b5b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:48.384054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3914a15ff3432baec432bf7f677b55', 'request_id': 'req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.453049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 979/1956] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:48 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:48.457985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158975d9-2426-4f75-a87f-2702cfe83b5b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:48.468463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3914a15ff3432baec432bf7f677b55', 'request_id': 'req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.468917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158975d9-2426-4f75-a87f-2702cfe83b5b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:48.478246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3914a15ff3432baec432bf7f677b55', 'request_id': 'req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.495372 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] The token cache is being invalidate because project ff3914a15ff3432baec432bf7f677b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:48.495785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.496670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.498578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 978/1957] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:48 2022] DELETE /identity/v3/projects/ff3914a15ff3432baec432bf7f677b55 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:48.503713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:48.505622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:48.539293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:48.540084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.540444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.541223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.542065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:48.544115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:48.555398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 980/1958] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:48.576295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:48.578206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:48.593205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d99a0e-fc4d-4070-8710-6b9c822c6e4a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:48.597628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a56f8a-036f-46bb-b7c6-11b2dd0e087b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:48.598878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e0147-67dd-4338-a17d-c28cbfb1e1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:48.599764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e0147-67dd-4338-a17d-c28cbfb1e1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.600057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e0147-67dd-4338-a17d-c28cbfb1e1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.600343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e0147-67dd-4338-a17d-c28cbfb1e1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.601115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e0147-67dd-4338-a17d-c28cbfb1e1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:48.602702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:48.602855 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e0147-67dd-4338-a17d-c28cbfb1e1d6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:48.603586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.603968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.604416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] PATH_INFO: `/v3/users/d4906678e53347ac84fe696c54c124a3` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.605730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4906678e53347ac84fe696c54c124a3)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:48.607855 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:48.617788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 981/1959] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:48.618751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e0147-67dd-4338-a17d-c28cbfb1e1d6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:48.629670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e0147-67dd-4338-a17d-c28cbfb1e1d6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:48.635787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59db0a7-1ee6-477d-9914-6d0c0fa42b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:48.636749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db0a7-1ee6-477d-9914-6d0c0fa42b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.637041 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db0a7-1ee6-477d-9914-6d0c0fa42b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.637322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59db0a7-1ee6-477d-9914-6d0c0fa42b8c admin admin] PATH_INFO: `/v3/projects/510685b846a54f48ba6747990ad35a29/users/25c6339aed9846b7b4538e92ef3f0ee7/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.655116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59db0a7-1ee6-477d-9914-6d0c0fa42b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=510685b846a54f48ba6747990ad35a29, user_id=25c6339aed9846b7b4538e92ef3f0ee7, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:48.659277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59db0a7-1ee6-477d-9914-6d0c0fa42b8c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:48.765044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 982/1960] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:48 2022] PUT /identity/v3/projects/510685b846a54f48ba6747990ad35a29/users/25c6339aed9846b7b4538e92ef3f0ee7/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:48.775863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64b7c-4f45-4386-8116-fb26276a1d4e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.776160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64b7c-4f45-4386-8116-fb26276a1d4e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.776447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64b7c-4f45-4386-8116-fb26276a1d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.806588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-00f64b7c-4f45-4386-8116-fb26276a1d4e None None] MFA Rules not processed for user `25c6339aed9846b7b4538e92ef3f0ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:48.807831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-00f64b7c-4f45-4386-8116-fb26276a1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:48.837442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4906678e53347ac84fe696c54c124a3'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.838180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4906678e53347ac84fe696c54c124a3'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.845452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4906678e53347ac84fe696c54c124a3'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.846245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4906678e53347ac84fe696c54c124a3'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.875690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 983/1961] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:48.880606 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f64b7c-4f45-4386-8116-fb26276a1d4e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:48.881936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-00f64b7c-4f45-4386-8116-fb26276a1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:48.932045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4906678e53347ac84fe696c54c124a3'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:48.947177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f64b7c-4f45-4386-8116-fb26276a1d4e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:48.952019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:48.953087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:48.953087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:48.953289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:48.953918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:48.955596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 979/1962] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:48 2022] DELETE /identity/v3/users/d4906678e53347ac84fe696c54c124a3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:48.956067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.077286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 984/1963] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:48 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:49.084172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.152304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5ddc8-668f-4848-921a-f96809f91e68 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.212556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4695448-081c-41e6-8caf-509cbf28775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.213252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4695448-081c-41e6-8caf-509cbf28775a admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.213361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.213822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4695448-081c-41e6-8caf-509cbf28775a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.213822 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4695448-081c-41e6-8caf-509cbf28775a admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.214508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4695448-081c-41e6-8caf-509cbf28775a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.215337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:49.216550 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4695448-081c-41e6-8caf-509cbf28775a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.233523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a8760-a150-457f-b536-8cb1ddf49f1b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.239231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.240143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.240430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.240708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] PATH_INFO: `/v3/users/ae62a41930fc470890096b0d0fcea5af` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.241910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae62a41930fc470890096b0d0fcea5af)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.244019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.301116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 980/1964] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:49 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:49.302499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4695448-081c-41e6-8caf-509cbf28775a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.313369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4695448-081c-41e6-8caf-509cbf28775a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.318670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b1a86-7b0b-4d04-a8ff-b3d50e756999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.319024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1a86-7b0b-4d04-a8ff-b3d50e756999 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.319312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1a86-7b0b-4d04-a8ff-b3d50e756999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.319618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b1a86-7b0b-4d04-a8ff-b3d50e756999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.320429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b1a86-7b0b-4d04-a8ff-b3d50e756999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.322046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b1a86-7b0b-4d04-a8ff-b3d50e756999 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.332410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 981/1965] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:49.345244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b1a86-7b0b-4d04-a8ff-b3d50e756999 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.356210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b1a86-7b0b-4d04-a8ff-b3d50e756999 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.361989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.362938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.363227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.363508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] PATH_INFO: `/v3/projects/06a3cefec54e416db0706554ca8ccf6f/users/ebb0611011354979ad51ee17858a1c84/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.382557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae62a41930fc470890096b0d0fcea5af'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.390029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae62a41930fc470890096b0d0fcea5af'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.390634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a3cefec54e416db0706554ca8ccf6f, user_id=ebb0611011354979ad51ee17858a1c84, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.391066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae62a41930fc470890096b0d0fcea5af'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.391718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae62a41930fc470890096b0d0fcea5af'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.395401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.451497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae62a41930fc470890096b0d0fcea5af'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.463363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 982/1966] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:49 2022] PUT /identity/v3/projects/06a3cefec54e416db0706554ca8ccf6f/users/ebb0611011354979ad51ee17858a1c84/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:49.468397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.471026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:49.488866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 985/1967] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:49 2022] DELETE /identity/v3/users/ae62a41930fc470890096b0d0fcea5af => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:49.489907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.491322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:49.556686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba7fd3-cc40-4200-90e3-7a13c0285893 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.561841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.562798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.563084 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.563361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] PATH_INFO: `/v3/projects/887af87dab6345d19b9592d53de44fc2` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.565345 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] RBAC: Authorizing `identity:delete_project(project_id=887af87dab6345d19b9592d53de44fc2)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.566158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909cf25-a229-4bba-a49d-0c80cacd4a07 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.567138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.572165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0eb4e-1995-4213-aa9e-e0f442937903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.572165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0eb4e-1995-4213-aa9e-e0f442937903 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.572399 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0eb4e-1995-4213-aa9e-e0f442937903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.572472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0eb4e-1995-4213-aa9e-e0f442937903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.573202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0eb4e-1995-4213-aa9e-e0f442937903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.574850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0eb4e-1995-4213-aa9e-e0f442937903 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.585678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 986/1968] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:49.589423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0eb4e-1995-4213-aa9e-e0f442937903 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.604471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0eb4e-1995-4213-aa9e-e0f442937903 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.609861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2af9d-1f76-4190-9a59-68b532fd81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.610871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2af9d-1f76-4190-9a59-68b532fd81dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.611882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2af9d-1f76-4190-9a59-68b532fd81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.612232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2af9d-1f76-4190-9a59-68b532fd81dc admin admin] PATH_INFO: `/v3/projects/06a3cefec54e416db0706554ca8ccf6f/users/ebb0611011354979ad51ee17858a1c84/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.614572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2af9d-1f76-4190-9a59-68b532fd81dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a3cefec54e416db0706554ca8ccf6f, user_id=ebb0611011354979ad51ee17858a1c84, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.617138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2af9d-1f76-4190-9a59-68b532fd81dc admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.635047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 987/1969] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:49 2022] PUT /identity/v3/projects/06a3cefec54e416db0706554ca8ccf6f/users/ebb0611011354979ad51ee17858a1c84/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:49.641062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be275-965d-4679-b5cb-3fac822c818f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.641427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be275-965d-4679-b5cb-3fac822c818f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.641718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6be275-965d-4679-b5cb-3fac822c818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.686216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-cc6be275-965d-4679-b5cb-3fac822c818f None None] MFA Rules not processed for user `ebb0611011354979ad51ee17858a1c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:49.687580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cc6be275-965d-4679-b5cb-3fac822c818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:49.736165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887af87dab6345d19b9592d53de44fc2', 'request_id': 'req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.802149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 988/1970] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:49.808255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6be275-965d-4679-b5cb-3fac822c818f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.809689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cc6be275-965d-4679-b5cb-3fac822c818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:49.823123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887af87dab6345d19b9592d53de44fc2', 'request_id': 'req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.829147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887af87dab6345d19b9592d53de44fc2', 'request_id': 'req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.840871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] The token cache is being invalidate because project 887af87dab6345d19b9592d53de44fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:49.841173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.841823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfc8381f-fb1e-4331-8b2d-d28481f1d66e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:49.843513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 983/1971] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:49 2022] DELETE /identity/v3/projects/887af87dab6345d19b9592d53de44fc2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:49.848938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbd3c-9de8-4649-ad5f-c6dbed19854f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.849365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbd3c-9de8-4649-ad5f-c6dbed19854f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.849830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbd3c-9de8-4649-ad5f-c6dbed19854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.880429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6be275-965d-4679-b5cb-3fac822c818f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.880615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-271fbd3c-9de8-4649-ad5f-c6dbed19854f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:49.881900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-271fbd3c-9de8-4649-ad5f-c6dbed19854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:49.922705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f69b1-3336-43a3-bd7b-35e9c757e28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.923558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f69b1-3336-43a3-bd7b-35e9c757e28a service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.923841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f69b1-3336-43a3-bd7b-35e9c757e28a service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.924114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f69b1-3336-43a3-bd7b-35e9c757e28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.925986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a51f69b1-3336-43a3-bd7b-35e9c757e28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:49.947886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 984/1972] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:49.951499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fbd3c-9de8-4649-ad5f-c6dbed19854f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:49.953460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-271fbd3c-9de8-4649-ad5f-c6dbed19854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:49.966896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fbd3c-9de8-4649-ad5f-c6dbed19854f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:49.972648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:49.973536 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:49.973885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:49.974169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] PATH_INFO: `/v3/projects/b5d76e6a7dfd480a9b78ccc02a1626b0` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:49.975475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d76e6a7dfd480a9b78ccc02a1626b0)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.977493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:49.997270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f69b1-3336-43a3-bd7b-35e9c757e28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:49.998898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f69b1-3336-43a3-bd7b-35e9c757e28a service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.012103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 989/1973] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:50.013384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e557f-f823-4e9c-8b4e-9939040cf57d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.013674 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e557f-f823-4e9c-8b4e-9939040cf57d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.014008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e557f-f823-4e9c-8b4e-9939040cf57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.034332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-901e557f-f823-4e9c-8b4e-9939040cf57d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:50.035605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-901e557f-f823-4e9c-8b4e-9939040cf57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:50.046146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 990/1974] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:50.051736 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e557f-f823-4e9c-8b4e-9939040cf57d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.068740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e557f-f823-4e9c-8b4e-9939040cf57d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.073332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d76e6a7dfd480a9b78ccc02a1626b0', 'request_id': 'req-4856681f-f35a-4568-b4e3-73de26a07505'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.118518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.119211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.119491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.119766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.120493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:50.120811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.122514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.134182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 991/1975] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:50.138467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.149329 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad017552-dd52-45e5-9cf6-daf07c471363 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.155157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.155812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.156098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.156375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.157475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.160214 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.187744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d76e6a7dfd480a9b78ccc02a1626b0', 'request_id': 'req-4856681f-f35a-4568-b4e3-73de26a07505'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.193563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d76e6a7dfd480a9b78ccc02a1626b0', 'request_id': 'req-4856681f-f35a-4568-b4e3-73de26a07505'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.204247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] The token cache is being invalidate because project b5d76e6a7dfd480a9b78ccc02a1626b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:50.204539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.205228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.206922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 985/1976] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:49 2022] DELETE /identity/v3/projects/b5d76e6a7dfd480a9b78ccc02a1626b0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:50.210656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.211952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:50.224703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856681f-f35a-4568-b4e3-73de26a07505 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.229810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.230722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.231016 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.237057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] PATH_INFO: `/v3/users/c72e5b86c0ed4eff991c552d155f9d79` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.237057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72e5b86c0ed4eff991c552d155f9d79)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.237057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.265523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 992/1977] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:50 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:50.269316 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.270964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:50.334398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1739-5117-407e-b96b-8dd2d68b9476 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.339053 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd450fa2-bb88-4b76-af47-91502a3c4d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.339728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450fa2-bb88-4b76-af47-91502a3c4d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.340020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450fa2-bb88-4b76-af47-91502a3c4d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.340424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd450fa2-bb88-4b76-af47-91502a3c4d97 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.341138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd450fa2-bb88-4b76-af47-91502a3c4d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.343104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd450fa2-bb88-4b76-af47-91502a3c4d97 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.434840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 993/1978] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:50 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:50.438981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd450fa2-bb88-4b76-af47-91502a3c4d97 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.447244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72e5b86c0ed4eff991c552d155f9d79'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.448297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72e5b86c0ed4eff991c552d155f9d79'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.450581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd450fa2-bb88-4b76-af47-91502a3c4d97 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.455932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.456143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72e5b86c0ed4eff991c552d155f9d79'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.456854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.456970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72e5b86c0ed4eff991c552d155f9d79'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.457142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.457424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.458160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.459809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.469769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 994/1979] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:50.474483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.476885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:50.493204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5fd26-ff5a-4cb8-8183-dc2363e1d42a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.500546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93ce3-5889-46e3-b9fc-5efeb000bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.501188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93ce3-5889-46e3-b9fc-5efeb000bfcb admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.501673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93ce3-5889-46e3-b9fc-5efeb000bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.502098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93ce3-5889-46e3-b9fc-5efeb000bfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.503328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c93ce3-5889-46e3-b9fc-5efeb000bfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.506504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c93ce3-5889-46e3-b9fc-5efeb000bfcb admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.522127 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 995/1980] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:50.526222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93ce3-5889-46e3-b9fc-5efeb000bfcb admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.539303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93ce3-5889-46e3-b9fc-5efeb000bfcb admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.546296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ad7d3-64fb-4647-9076-87639d3aa294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.547222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad7d3-64fb-4647-9076-87639d3aa294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.547507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad7d3-64fb-4647-9076-87639d3aa294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.547834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad7d3-64fb-4647-9076-87639d3aa294 admin admin] PATH_INFO: `/v3/projects/a34b70cab62b4112a3cfba088420fe5c/users/0881e80dc14f4efcbf212a3455fbd181/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.566177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ad7d3-64fb-4647-9076-87639d3aa294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34b70cab62b4112a3cfba088420fe5c, user_id=0881e80dc14f4efcbf212a3455fbd181, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.568895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ad7d3-64fb-4647-9076-87639d3aa294 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.588431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-19d25d40-b5bd-4862-88ed-a3a464d27ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72e5b86c0ed4eff991c552d155f9d79'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:50.607958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 986/1981] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:50 2022] DELETE /identity/v3/users/c72e5b86c0ed4eff991c552d155f9d79 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:50.680089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 996/1982] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:50 2022] PUT /identity/v3/projects/a34b70cab62b4112a3cfba088420fe5c/users/0881e80dc14f4efcbf212a3455fbd181/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:50.692805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf496-cc08-44d9-b4c5-a955c1bfef4c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.693106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf496-cc08-44d9-b4c5-a955c1bfef4c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.693700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf496-cc08-44d9-b4c5-a955c1bfef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.724548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-4abdf496-cc08-44d9-b4c5-a955c1bfef4c None None] MFA Rules not processed for user `0881e80dc14f4efcbf212a3455fbd181`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:50.725778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4abdf496-cc08-44d9-b4c5-a955c1bfef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:50.795836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 987/1983] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:50.800607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ad7d3-64fb-4647-9076-87639d3aa294 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.851621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdf496-cc08-44d9-b4c5-a955c1bfef4c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:50.856542 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4abdf496-cc08-44d9-b4c5-a955c1bfef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:50.907514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ad7d3-64fb-4647-9076-87639d3aa294 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.912586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566adcf9-84bd-4e9b-b97b-fbe6960d9c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.913410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566adcf9-84bd-4e9b-b97b-fbe6960d9c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.913707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566adcf9-84bd-4e9b-b97b-fbe6960d9c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.913987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566adcf9-84bd-4e9b-b97b-fbe6960d9c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.914993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566adcf9-84bd-4e9b-b97b-fbe6960d9c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.917123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566adcf9-84bd-4e9b-b97b-fbe6960d9c7a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:50.964007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdf496-cc08-44d9-b4c5-a955c1bfef4c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:50.969216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:50.970115 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:50.974993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:50.974993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] PATH_INFO: `/v3/projects/16e68e0ccff8494baeefe2d4bd79b5c0` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:50.974993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e68e0ccff8494baeefe2d4bd79b5c0)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:50.974993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.037277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 997/1984] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:50 2022] POST /identity/v3/projects => generated 365 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:51.041638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566adcf9-84bd-4e9b-b97b-fbe6960d9c7a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.106554 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566adcf9-84bd-4e9b-b97b-fbe6960d9c7a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.113703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e68e0ccff8494baeefe2d4bd79b5c0', 'request_id': 'req-7600531b-4fee-424d-bfaf-acef533739e9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.162111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb4dc8-7733-49f7-b53d-8f148a7e94f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.162813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb4dc8-7733-49f7-b53d-8f148a7e94f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.163097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb4dc8-7733-49f7-b53d-8f148a7e94f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.163374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb4dc8-7733-49f7-b53d-8f148a7e94f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.164056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb4dc8-7733-49f7-b53d-8f148a7e94f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.165977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb4dc8-7733-49f7-b53d-8f148a7e94f7 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.233880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e68e0ccff8494baeefe2d4bd79b5c0', 'request_id': 'req-7600531b-4fee-424d-bfaf-acef533739e9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.240412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e68e0ccff8494baeefe2d4bd79b5c0', 'request_id': 'req-7600531b-4fee-424d-bfaf-acef533739e9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.253003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] The token cache is being invalidate because project 16e68e0ccff8494baeefe2d4bd79b5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:51.253290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.253960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.255629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 988/1985] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:50 2022] DELETE /identity/v3/projects/16e68e0ccff8494baeefe2d4bd79b5c0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:51.258977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.258977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.266604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 998/1986] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:51 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:51.271861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600531b-4fee-424d-bfaf-acef533739e9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.273078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5009-75a1-4183-af0b-65e90944c42d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.273378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5009-75a1-4183-af0b-65e90944c42d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.273732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5009-75a1-4183-af0b-65e90944c42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.277097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.278000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.278468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.278915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] PATH_INFO: `/v3/users/d05f1793893d417080728916423a50d1` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.280212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05f1793893d417080728916423a50d1)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.282279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.292733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-df9a5009-75a1-4183-af0b-65e90944c42d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:51.294069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-df9a5009-75a1-4183-af0b-65e90944c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.303849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 999/1987] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:51.307904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5009-75a1-4183-af0b-65e90944c42d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.307904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-df9a5009-75a1-4183-af0b-65e90944c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.322245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5009-75a1-4183-af0b-65e90944c42d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.327327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159640ae-6e55-4ecc-b09c-5d8aee91dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.327993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159640ae-6e55-4ecc-b09c-5d8aee91dd4c admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.328274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159640ae-6e55-4ecc-b09c-5d8aee91dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.328546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159640ae-6e55-4ecc-b09c-5d8aee91dd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.329364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159640ae-6e55-4ecc-b09c-5d8aee91dd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.331103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159640ae-6e55-4ecc-b09c-5d8aee91dd4c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.341325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1000/1988] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:51.342456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f37b-14b8-4a76-8d5e-e4eedc9813e9 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.342802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f37b-14b8-4a76-8d5e-e4eedc9813e9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.343086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8f37b-14b8-4a76-8d5e-e4eedc9813e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.362288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-27d8f37b-14b8-4a76-8d5e-e4eedc9813e9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:51.363437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-27d8f37b-14b8-4a76-8d5e-e4eedc9813e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.372649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1001/1989] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:51.372649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8f37b-14b8-4a76-8d5e-e4eedc9813e9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.385447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8f37b-14b8-4a76-8d5e-e4eedc9813e9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.390219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.391134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.391420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.391697 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] PATH_INFO: `/v3/projects/cbb8ed99ae4d4ad3826ceb6daed11033/users/ce7a79b3ed8b4ef885fc171206f32c22/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.406750 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb8ed99ae4d4ad3826ceb6daed11033, user_id=ce7a79b3ed8b4ef885fc171206f32c22, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.409701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.436250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05f1793893d417080728916423a50d1'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.436938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05f1793893d417080728916423a50d1'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.444938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05f1793893d417080728916423a50d1'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.445625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05f1793893d417080728916423a50d1'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.462524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1002/1990] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:51 2022] PUT /identity/v3/projects/cbb8ed99ae4d4ad3826ceb6daed11033/users/ce7a79b3ed8b4ef885fc171206f32c22/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:51.463398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.465477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.530866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05f1793893d417080728916423a50d1'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:51.541612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684952d-65b6-416c-b686-937d48e98fb8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.550091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ff9bd-24ca-4c45-92e1-34f255c6664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.551272 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ff9bd-24ca-4c45-92e1-34f255c6664a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.551792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ff9bd-24ca-4c45-92e1-34f255c6664a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.552298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ff9bd-24ca-4c45-92e1-34f255c6664a admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.553404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ff9bd-24ca-4c45-92e1-34f255c6664a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:51.553719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ff9bd-24ca-4c45-92e1-34f255c6664a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.555601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ff9bd-24ca-4c45-92e1-34f255c6664a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.558634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 989/1991] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:51 2022] DELETE /identity/v3/users/d05f1793893d417080728916423a50d1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:51.563335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.565262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.571506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1003/1992] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:51.571506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d40730-2633-4017-87db-2e2ec5577032 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.571506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d40730-2633-4017-87db-2e2ec5577032 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.571506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d40730-2633-4017-87db-2e2ec5577032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.589357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d1d40730-2633-4017-87db-2e2ec5577032 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:51.590598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d1d40730-2633-4017-87db-2e2ec5577032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.637456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d7be6-71aa-413d-a09d-b46bf584e22f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.642104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.642829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.643133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.643417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.645525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.645845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.650512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1004/1993] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:51.653727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d40730-2633-4017-87db-2e2ec5577032 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.660368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 990/1994] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:51.661287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.662975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.665357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d40730-2633-4017-87db-2e2ec5577032 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.670109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe63a-d089-4702-963e-4a8c5400e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.670805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe63a-d089-4702-963e-4a8c5400e7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.671093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe63a-d089-4702-963e-4a8c5400e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.671371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe63a-d089-4702-963e-4a8c5400e7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.672068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe63a-d089-4702-963e-4a8c5400e7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.674870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe63a-d089-4702-963e-4a8c5400e7d9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.717404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc2e89-9580-4b9c-b54d-30a31aa3df0c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.721702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff84d3f-ea71-41d9-b322-ecfc16823ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.722348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff84d3f-ea71-41d9-b322-ecfc16823ffd service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.722846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff84d3f-ea71-41d9-b322-ecfc16823ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.722846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff84d3f-ea71-41d9-b322-ecfc16823ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.733649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff84d3f-ea71-41d9-b322-ecfc16823ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.735474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff84d3f-ea71-41d9-b322-ecfc16823ffd service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.741131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1005/1995] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:51 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:51.744466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe63a-d089-4702-963e-4a8c5400e7d9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.747818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 991/1996] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:51.749234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff84d3f-ea71-41d9-b322-ecfc16823ffd service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.765914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff84d3f-ea71-41d9-b322-ecfc16823ffd service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.828081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595fa8b-d6c6-41f9-8006-22a7bcef31c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.828503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595fa8b-d6c6-41f9-8006-22a7bcef31c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.828851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595fa8b-d6c6-41f9-8006-22a7bcef31c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.829145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595fa8b-d6c6-41f9-8006-22a7bcef31c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.829958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595fa8b-d6c6-41f9-8006-22a7bcef31c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.831985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595fa8b-d6c6-41f9-8006-22a7bcef31c1 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.849563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe63a-d089-4702-963e-4a8c5400e7d9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.857126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968d7c8-7516-4914-9b86-17abe8998fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.858743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968d7c8-7516-4914-9b86-17abe8998fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.859063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968d7c8-7516-4914-9b86-17abe8998fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.859501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968d7c8-7516-4914-9b86-17abe8998fe8 admin admin] PATH_INFO: `/v3/projects/cbb8ed99ae4d4ad3826ceb6daed11033/users/ce7a79b3ed8b4ef885fc171206f32c22/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.871162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968d7c8-7516-4914-9b86-17abe8998fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb8ed99ae4d4ad3826ceb6daed11033, user_id=ce7a79b3ed8b4ef885fc171206f32c22, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.874244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968d7c8-7516-4914-9b86-17abe8998fe8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.886109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1006/1997] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:51 2022] PUT /identity/v3/projects/cbb8ed99ae4d4ad3826ceb6daed11033/users/ce7a79b3ed8b4ef885fc171206f32c22/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:51.898476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f2c5-ee70-4b2c-b42a-0feb7dd00f79 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.898991 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f2c5-ee70-4b2c-b42a-0feb7dd00f79 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.899278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600f2c5-ee70-4b2c-b42a-0feb7dd00f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.901025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 992/1998] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:51 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:51.905675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595fa8b-d6c6-41f9-8006-22a7bcef31c1 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:51.918874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595fa8b-d6c6-41f9-8006-22a7bcef31c1 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:51.931500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f600f2c5-ee70-4b2c-b42a-0feb7dd00f79 None None] MFA Rules not processed for user `ce7a79b3ed8b4ef885fc171206f32c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:51.933458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f600f2c5-ee70-4b2c-b42a-0feb7dd00f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:51.981093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2078-f0cc-4402-8f30-48551f234c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:51.981780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2078-f0cc-4402-8f30-48551f234c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:51.982065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2078-f0cc-4402-8f30-48551f234c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:51.982344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2078-f0cc-4402-8f30-48551f234c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:51.983138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2078-f0cc-4402-8f30-48551f234c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:51.984737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2078-f0cc-4402-8f30-48551f234c92 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:51.996878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 993/1999] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:52.004230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2078-f0cc-4402-8f30-48551f234c92 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.014880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2078-f0cc-4402-8f30-48551f234c92 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.023641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1007/2000] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:52.023984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5cbe3-e744-4ba9-8aaf-ce38275fdf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.023984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5cbe3-e744-4ba9-8aaf-ce38275fdf89 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.023984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5cbe3-e744-4ba9-8aaf-ce38275fdf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.023984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5cbe3-e744-4ba9-8aaf-ce38275fdf89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.024396 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5cbe3-e744-4ba9-8aaf-ce38275fdf89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.027400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5cbe3-e744-4ba9-8aaf-ce38275fdf89 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.037918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600f2c5-ee70-4b2c-b42a-0feb7dd00f79 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.039700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f600f2c5-ee70-4b2c-b42a-0feb7dd00f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:52.043025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 994/2001] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:52.044457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5cbe3-e744-4ba9-8aaf-ce38275fdf89 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.067673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5cbe3-e744-4ba9-8aaf-ce38275fdf89 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.083069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc0857-bec0-4015-a7cb-6e1c6dbc76b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.083988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc0857-bec0-4015-a7cb-6e1c6dbc76b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.084277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc0857-bec0-4015-a7cb-6e1c6dbc76b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.084559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc0857-bec0-4015-a7cb-6e1c6dbc76b4 admin admin] PATH_INFO: `/v3/projects/ce5c3775c723407e99f26881bd680f8c/users/3bb45ab7b23c444ea91a74695da62de4/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.116396 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc0857-bec0-4015-a7cb-6e1c6dbc76b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5c3775c723407e99f26881bd680f8c, user_id=3bb45ab7b23c444ea91a74695da62de4, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.121798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc0857-bec0-4015-a7cb-6e1c6dbc76b4 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.142954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600f2c5-ee70-4b2c-b42a-0feb7dd00f79 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.148504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.149165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.149475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.149752 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.163603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.165148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.175199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1008/2002] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:52.176020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.177304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:52.189107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345255e-4da5-43fc-8db2-aa4c3fe07ec1 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.193061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.193713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.194358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.194358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.196331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:52.219018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 995/2003] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:52 2022] PUT /identity/v3/projects/ce5c3775c723407e99f26881bd680f8c/users/3bb45ab7b23c444ea91a74695da62de4/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:52.228024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433264-c27c-44d8-99a6-5c7f83a29b17 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.228333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433264-c27c-44d8-99a6-5c7f83a29b17 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.228705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433264-c27c-44d8-99a6-5c7f83a29b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.264147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-91433264-c27c-44d8-99a6-5c7f83a29b17 None None] MFA Rules not processed for user `3bb45ab7b23c444ea91a74695da62de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:52.265485 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-91433264-c27c-44d8-99a6-5c7f83a29b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:52.283820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.285563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.298313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1009/2004] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:52.299219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.300541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:52.315778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a211e31-94f9-4b91-a41b-5e08ed56d7e1 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.344431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 996/2005] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:52.349023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91433264-c27c-44d8-99a6-5c7f83a29b17 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.395405 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.396209 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.396498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.396775 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] PATH_INFO: `/v3/projects/c3b725dbc9f04d5cacbbcae2d7996f60` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.398089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b725dbc9f04d5cacbbcae2d7996f60)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.400194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.415284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91433264-c27c-44d8-99a6-5c7f83a29b17 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.420349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b225-4788-47e8-b200-823f3f59efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.421048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b225-4788-47e8-b200-823f3f59efbf admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.421337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b225-4788-47e8-b200-823f3f59efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.425066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b225-4788-47e8-b200-823f3f59efbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.425066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6b225-4788-47e8-b200-823f3f59efbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.425066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6b225-4788-47e8-b200-823f3f59efbf admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.524197 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 997/2006] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:52 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:52.525259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b225-4788-47e8-b200-823f3f59efbf admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.531165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b725dbc9f04d5cacbbcae2d7996f60', 'request_id': 'req-173f703a-5056-405a-addf-0836bdf27090'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.606344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b225-4788-47e8-b200-823f3f59efbf admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.606443 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b725dbc9f04d5cacbbcae2d7996f60', 'request_id': 'req-173f703a-5056-405a-addf-0836bdf27090'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.609796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b725dbc9f04d5cacbbcae2d7996f60', 'request_id': 'req-173f703a-5056-405a-addf-0836bdf27090'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.622863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.624166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.624568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.624971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.625206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] The token cache is being invalidate because project c3b725dbc9f04d5cacbbcae2d7996f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:52.625524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.626213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.626319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.628120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1010/2007] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:52 2022] DELETE /identity/v3/projects/c3b725dbc9f04d5cacbbcae2d7996f60 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:52.631329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.631709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.634407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:52.708908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f703a-5056-405a-addf-0836bdf27090 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.713777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.714694 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.714986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.715271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] PATH_INFO: `/v3/users/2b52227d04fb473d8eaa3e71068abc87` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.716525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b52227d04fb473d8eaa3e71068abc87)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.718476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.728810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 998/2008] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:52 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:52.732874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.734719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:52.746849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e51b-e835-44ea-a351-deab9bde170e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.751648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cfec4-c14b-4aeb-8ec8-3e90a5d09c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.752322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfec4-c14b-4aeb-8ec8-3e90a5d09c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.752603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfec4-c14b-4aeb-8ec8-3e90a5d09c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.752890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cfec4-c14b-4aeb-8ec8-3e90a5d09c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.753618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cfec4-c14b-4aeb-8ec8-3e90a5d09c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.755276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cfec4-c14b-4aeb-8ec8-3e90a5d09c03 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.765328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 999/2009] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:52.769847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cfec4-c14b-4aeb-8ec8-3e90a5d09c03 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.779440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cfec4-c14b-4aeb-8ec8-3e90a5d09c03 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.790052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff047b37-46a1-4cde-9d6d-e86cbdfcf801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.790052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff047b37-46a1-4cde-9d6d-e86cbdfcf801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.790052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff047b37-46a1-4cde-9d6d-e86cbdfcf801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.790052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff047b37-46a1-4cde-9d6d-e86cbdfcf801 admin admin] PATH_INFO: `/v3/projects/0971668c835e49cfa7be77e606d9c682/users/220e0a52eead46768a1bb7007b78692d/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.801878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff047b37-46a1-4cde-9d6d-e86cbdfcf801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0971668c835e49cfa7be77e606d9c682, user_id=220e0a52eead46768a1bb7007b78692d, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.804546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff047b37-46a1-4cde-9d6d-e86cbdfcf801 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.889717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1000/2010] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:52 2022] PUT /identity/v3/projects/0971668c835e49cfa7be77e606d9c682/users/220e0a52eead46768a1bb7007b78692d/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:52.892708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff047b37-46a1-4cde-9d6d-e86cbdfcf801 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.949766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b52227d04fb473d8eaa3e71068abc87'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.953975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff047b37-46a1-4cde-9d6d-e86cbdfcf801 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:52.957412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b52227d04fb473d8eaa3e71068abc87'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.958151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b52227d04fb473d8eaa3e71068abc87'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.958876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b52227d04fb473d8eaa3e71068abc87'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:52.960206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:52.961087 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:52.961380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:52.961663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:52.962434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:52.964116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:52.982066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1001/2011] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:39:52.986126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:52.988066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:53.000655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ccc5-b130-4c30-885c-5f15934d643a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:53.005931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5084944-bcf0-40f5-94cc-1b374841d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:53.006846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084944-bcf0-40f5-94cc-1b374841d9ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:53.007130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084944-bcf0-40f5-94cc-1b374841d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:53.007426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084944-bcf0-40f5-94cc-1b374841d9ce admin admin] PATH_INFO: `/v3/projects/0971668c835e49cfa7be77e606d9c682/users/220e0a52eead46768a1bb7007b78692d/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:53.009388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5084944-bcf0-40f5-94cc-1b374841d9ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0971668c835e49cfa7be77e606d9c682, user_id=220e0a52eead46768a1bb7007b78692d, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:53.012039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5084944-bcf0-40f5-94cc-1b374841d9ce admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:53.022937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1002/2012] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:52 2022] PUT /identity/v3/projects/0971668c835e49cfa7be77e606d9c682/users/220e0a52eead46768a1bb7007b78692d/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:53.034691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4490-7ba0-4857-b118-3488ea4b9200 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:53.035064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4490-7ba0-4857-b118-3488ea4b9200 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:53.035417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca4490-7ba0-4857-b118-3488ea4b9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:53.040079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b52227d04fb473d8eaa3e71068abc87'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.062186 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1011/2013] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:52 2022] DELETE /identity/v3/users/2b52227d04fb473d8eaa3e71068abc87 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:53.066490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e3ca4490-7ba0-4857-b118-3488ea4b9200 None None] MFA Rules not processed for user `220e0a52eead46768a1bb7007b78692d`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:53.067376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e3ca4490-7ba0-4857-b118-3488ea4b9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:53.138934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1003/2014] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:53.173538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:53.173687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca4490-7ba0-4857-b118-3488ea4b9200 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:53.175015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:53.175220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e3ca4490-7ba0-4857-b118-3488ea4b9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:53.235648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee031747-5ff2-434f-9b02-9f1493d7a2b3 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:53.239695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4875fd5-4529-434f-a76e-adaf449cfc66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:53.240008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875fd5-4529-434f-a76e-adaf449cfc66 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:53.240284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875fd5-4529-434f-a76e-adaf449cfc66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:53.240570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4875fd5-4529-434f-a76e-adaf449cfc66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:53.242939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e4875fd5-4529-434f-a76e-adaf449cfc66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:53.243069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca4490-7ba0-4857-b118-3488ea4b9200 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:53.248609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:53.249502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:53.256326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:53.256326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] PATH_INFO: `/v3/users/0881e80dc14f4efcbf212a3455fbd181` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:53.256326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0881e80dc14f4efcbf212a3455fbd181)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:53.256326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:53.310960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4875fd5-4529-434f-a76e-adaf449cfc66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:53.312429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4875fd5-4529-434f-a76e-adaf449cfc66 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:53.323574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1012/2015] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:53.483964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0881e80dc14f4efcbf212a3455fbd181'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.484688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0881e80dc14f4efcbf212a3455fbd181'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.493883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0881e80dc14f4efcbf212a3455fbd181'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.494574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0881e80dc14f4efcbf212a3455fbd181'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.564368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0881e80dc14f4efcbf212a3455fbd181'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.581972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1004/2016] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:53 2022] DELETE /identity/v3/users/0881e80dc14f4efcbf212a3455fbd181 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:53.586579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35370f4-03a2-407a-9f8c-83ee83a95515 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:53.586871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35370f4-03a2-407a-9f8c-83ee83a95515 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:53.587151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35370f4-03a2-407a-9f8c-83ee83a95515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:53.601175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:53.603163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:53.605691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f35370f4-03a2-407a-9f8c-83ee83a95515 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:53.606903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f35370f4-03a2-407a-9f8c-83ee83a95515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:53.671662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1013/2017] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:53.681961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35370f4-03a2-407a-9f8c-83ee83a95515 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:53.683812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f35370f4-03a2-407a-9f8c-83ee83a95515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:53.688885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde17f6-8742-4fbf-bd3c-93d16b562c16 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:53.695617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:53.696016 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:53.696299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:53.696654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] PATH_INFO: `/v3/projects/10096d6e8e84412888ed4b9a448b3a3c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:53.698572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10096d6e8e84412888ed4b9a448b3a3c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:53.700626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:53.755540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35370f4-03a2-407a-9f8c-83ee83a95515 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:53.759378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e403c1-b1ab-4b2f-97e7-560cf9689994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:53.760637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e403c1-b1ab-4b2f-97e7-560cf9689994 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:53.760637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e403c1-b1ab-4b2f-97e7-560cf9689994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:53.760637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e403c1-b1ab-4b2f-97e7-560cf9689994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:53.771136 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e403c1-b1ab-4b2f-97e7-560cf9689994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:53.772728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e403c1-b1ab-4b2f-97e7-560cf9689994 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:53.784238 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1014/2018] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:53.811389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10096d6e8e84412888ed4b9a448b3a3c', 'request_id': 'req-ba9670aa-ade4-41e9-944a-12cf2ff8f359'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.892735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10096d6e8e84412888ed4b9a448b3a3c', 'request_id': 'req-ba9670aa-ade4-41e9-944a-12cf2ff8f359'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.899681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10096d6e8e84412888ed4b9a448b3a3c', 'request_id': 'req-ba9670aa-ade4-41e9-944a-12cf2ff8f359'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.911023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] The token cache is being invalidate because project 10096d6e8e84412888ed4b9a448b3a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:53.911390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.912121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:53.913834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1005/2019] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:53 2022] DELETE /identity/v3/projects/10096d6e8e84412888ed4b9a448b3a3c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:53.917797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e403c1-b1ab-4b2f-97e7-560cf9689994 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:53.927866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e403c1-b1ab-4b2f-97e7-560cf9689994 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:53.996721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:53.998408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:53.998823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:53.999246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] PATH_INFO: `/v3/users/0f27bcdfa70e4c7698e41e266f8d0c9c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:54.001225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f27bcdfa70e4c7698e41e266f8d0c9c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:54.004518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:54.268369 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f27bcdfa70e4c7698e41e266f8d0c9c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.276342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f27bcdfa70e4c7698e41e266f8d0c9c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.277133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f27bcdfa70e4c7698e41e266f8d0c9c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.277754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f27bcdfa70e4c7698e41e266f8d0c9c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.294903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:54.296409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:54.354728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f27bcdfa70e4c7698e41e266f8d0c9c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.356937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9670aa-ade4-41e9-944a-12cf2ff8f359 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:54.361724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:54.362653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:54.363005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:54.363349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:54.365405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:54.384664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1015/2020] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:53 2022] DELETE /identity/v3/users/0f27bcdfa70e4c7698e41e266f8d0c9c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:54.384664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:54.388047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:54.465405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:54.468004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:54.494087 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1006/2021] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:39:54.500720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6b1b-7f09-4acc-a57d-4ccd7bc5c6ed admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:54.506637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:54.507883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:54.508284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:54.508661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] PATH_INFO: `/v3/projects/a34b70cab62b4112a3cfba088420fe5c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:54.509984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34b70cab62b4112a3cfba088420fe5c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:54.512086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:54.657130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34b70cab62b4112a3cfba088420fe5c', 'request_id': 'req-716e1085-ca6a-46f1-b57d-ffbe58834953'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.697074 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34b70cab62b4112a3cfba088420fe5c', 'request_id': 'req-716e1085-ca6a-46f1-b57d-ffbe58834953'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.705425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34b70cab62b4112a3cfba088420fe5c', 'request_id': 'req-716e1085-ca6a-46f1-b57d-ffbe58834953'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.725139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] The token cache is being invalidate because project a34b70cab62b4112a3cfba088420fe5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:54.725374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.726465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:54.727717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1016/2022] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:54 2022] DELETE /identity/v3/projects/a34b70cab62b4112a3cfba088420fe5c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:54.731791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:54.743064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea149494-8fe2-4426-a286-cc54018e60c5 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:54.804997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:54.805859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:54.806138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:54.806419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] PATH_INFO: `/v3/users/ce7a79b3ed8b4ef885fc171206f32c22` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:54.807644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7a79b3ed8b4ef885fc171206f32c22)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:54.809569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:54.916144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:54.917793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:54.931619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e1085-ca6a-46f1-b57d-ffbe58834953 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:54.937131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:54.940229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:54.940229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:54.945828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] PATH_INFO: `/v3/projects/2a9c80705dc542d0b28daa5e69d2bf81` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:54.947211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9c80705dc542d0b28daa5e69d2bf81)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:54.949179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:55.102930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7a79b3ed8b4ef885fc171206f32c22'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.103617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7a79b3ed8b4ef885fc171206f32c22'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.116718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9c80705dc542d0b28daa5e69d2bf81', 'request_id': 'req-3816f51c-debc-4fbc-84ca-6e584d99f879'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.118866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7a79b3ed8b4ef885fc171206f32c22'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.120236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7a79b3ed8b4ef885fc171206f32c22'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.211116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9c80705dc542d0b28daa5e69d2bf81', 'request_id': 'req-3816f51c-debc-4fbc-84ca-6e584d99f879'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.217432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9c80705dc542d0b28daa5e69d2bf81', 'request_id': 'req-3816f51c-debc-4fbc-84ca-6e584d99f879'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.229355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] The token cache is being invalidate because project 2a9c80705dc542d0b28daa5e69d2bf81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:55.229643 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.230274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3816f51c-debc-4fbc-84ca-6e584d99f879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.231903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1017/2023] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:54 2022] DELETE /identity/v3/projects/2a9c80705dc542d0b28daa5e69d2bf81 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:55.236547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed146e35-0463-4f2c-90ca-f9b9fc4a9fe9 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.236837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed146e35-0463-4f2c-90ca-f9b9fc4a9fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.237139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed146e35-0463-4f2c-90ca-f9b9fc4a9fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.254640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ed146e35-0463-4f2c-90ca-f9b9fc4a9fe9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:55.255842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ed146e35-0463-4f2c-90ca-f9b9fc4a9fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:55.326320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1018/2024] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:55.327928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae042f6-320f-458d-99b4-62cf92592d95 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.328222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae042f6-320f-458d-99b4-62cf92592d95 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.328502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae042f6-320f-458d-99b4-62cf92592d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.338755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7a79b3ed8b4ef885fc171206f32c22'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:55.349805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-6ae042f6-320f-458d-99b4-62cf92592d95 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:55.351006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6ae042f6-320f-458d-99b4-62cf92592d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:55.361326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1019/2025] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:55.364312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1007/2026] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:54 2022] DELETE /identity/v3/users/ce7a79b3ed8b4ef885fc171206f32c22 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:55.365577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae042f6-320f-458d-99b4-62cf92592d95 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:55.376271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae042f6-320f-458d-99b4-62cf92592d95 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:55.451578 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:55.452545 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.452826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.453192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.454331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:55.454331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:55.456659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:55.470710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1020/2027] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:55.475036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:55.478462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:55.490211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c38c-f328-4ff5-b601-9cd2b00ce25e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:55.495368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ae14-0542-4ade-b94e-6207aec6875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:55.496038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ae14-0542-4ade-b94e-6207aec6875d admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.496328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ae14-0542-4ade-b94e-6207aec6875d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.496614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6ae14-0542-4ade-b94e-6207aec6875d admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.497392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6ae14-0542-4ade-b94e-6207aec6875d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:55.499342 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6ae14-0542-4ade-b94e-6207aec6875d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:55.570571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1008/2028] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:55 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:55.571949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:55.584471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33ebee-654f-4119-bea2-1f422c6324ba admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:55.653555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb84d-1741-41ce-b534-8d5f707ca460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:55.654238 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb84d-1741-41ce-b534-8d5f707ca460 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.654557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb84d-1741-41ce-b534-8d5f707ca460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.654831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeb84d-1741-41ce-b534-8d5f707ca460 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.655549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeb84d-1741-41ce-b534-8d5f707ca460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:55.657833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeb84d-1741-41ce-b534-8d5f707ca460 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:55.749137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1021/2029] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:55 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:55.753778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ae14-0542-4ade-b94e-6207aec6875d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:55.766701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6ae14-0542-4ade-b94e-6207aec6875d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:55.771723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144cac2-d99b-403c-a558-3b8eb695af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:55.772393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cac2-d99b-403c-a558-3b8eb695af1a admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.772679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cac2-d99b-403c-a558-3b8eb695af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.772955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144cac2-d99b-403c-a558-3b8eb695af1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.773718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144cac2-d99b-403c-a558-3b8eb695af1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:55.775382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144cac2-d99b-403c-a558-3b8eb695af1a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:55.787135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1009/2030] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:55.790960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb84d-1741-41ce-b534-8d5f707ca460 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:55.804664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeb84d-1741-41ce-b534-8d5f707ca460 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:55.810189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:55.811036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.811407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.811901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.812945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:55.815675 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:55.830621 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1022/2031] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:55.835695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144cac2-d99b-403c-a558-3b8eb695af1a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:55.849452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:55.854647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144cac2-d99b-403c-a558-3b8eb695af1a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:55.863749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:55.878529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830a791-5ef9-4061-a52d-df543fe8cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:55.881323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a791-5ef9-4061-a52d-df543fe8cd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.881619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a791-5ef9-4061-a52d-df543fe8cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.881907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a791-5ef9-4061-a52d-df543fe8cd93 admin admin] PATH_INFO: `/v3/projects/1f91d5c21dce433fba4371f243db54b4/users/376982e96dd94a929bf1c14f63876960/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.900544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e2553-3201-450b-92c9-d4cf51df7a78 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:55.915613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830a791-5ef9-4061-a52d-df543fe8cd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f91d5c21dce433fba4371f243db54b4, user_id=376982e96dd94a929bf1c14f63876960, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:55.918568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830a791-5ef9-4061-a52d-df543fe8cd93 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:55.920985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:55.921946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:55.922232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:55.922512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] PATH_INFO: `/v3/projects/cbb8ed99ae4d4ad3826ceb6daed11033` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:55.925112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb8ed99ae4d4ad3826ceb6daed11033)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:55.927187 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:56.011991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1010/2032] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:55 2022] PUT /identity/v3/projects/1f91d5c21dce433fba4371f243db54b4/users/376982e96dd94a929bf1c14f63876960/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:56.023734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922c9f-9cc1-46ca-a950-5ba349e0303a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.024026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922c9f-9cc1-46ca-a950-5ba349e0303a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.024423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c922c9f-9cc1-46ca-a950-5ba349e0303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.055246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb8ed99ae4d4ad3826ceb6daed11033', 'request_id': 'req-edcf49cc-2a44-4f97-acd0-902a2268d2eb'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:56.067843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6c922c9f-9cc1-46ca-a950-5ba349e0303a None None] MFA Rules not processed for user `376982e96dd94a929bf1c14f63876960`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:56.069199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6c922c9f-9cc1-46ca-a950-5ba349e0303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:56.125721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb8ed99ae4d4ad3826ceb6daed11033', 'request_id': 'req-edcf49cc-2a44-4f97-acd0-902a2268d2eb'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:56.134826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb8ed99ae4d4ad3826ceb6daed11033', 'request_id': 'req-edcf49cc-2a44-4f97-acd0-902a2268d2eb'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:56.140359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1011/2033] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:56.149021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] The token cache is being invalidate because project cbb8ed99ae4d4ad3826ceb6daed11033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:39:56.149319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:56.150000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-edcf49cc-2a44-4f97-acd0-902a2268d2eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:56.151456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922c9f-9cc1-46ca-a950-5ba349e0303a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:56.155195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1023/2034] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:39:55 2022] DELETE /identity/v3/projects/cbb8ed99ae4d4ad3826ceb6daed11033 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:39:56.155888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6c922c9f-9cc1-46ca-a950-5ba349e0303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:56.156343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936375-07eb-407e-b0d0-ef4becc983e7 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.156635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936375-07eb-407e-b0d0-ef4becc983e7 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.157218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d936375-07eb-407e-b0d0-ef4becc983e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.178766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8d936375-07eb-407e-b0d0-ef4becc983e7 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:56.179976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8d936375-07eb-407e-b0d0-ef4becc983e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:56.224301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c922c9f-9cc1-46ca-a950-5ba349e0303a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:56.229732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:56.230448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.230871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.231768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.233802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:56.246796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1024/2035] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:56.252146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:56.253592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:56.254279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe809a-fed8-44bb-8b58-df9b6e680625 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.254681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe809a-fed8-44bb-8b58-df9b6e680625 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.255269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe809a-fed8-44bb-8b58-df9b6e680625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.263563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1012/2036] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:56.274476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1bbe809a-fed8-44bb-8b58-df9b6e680625 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:56.275830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1bbe809a-fed8-44bb-8b58-df9b6e680625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:56.284741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1025/2037] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:39:56.288966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:56.300148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fd641-a9eb-4303-a422-573eaea6f94d service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:56.304786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:56.305441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.305751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.306033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.306815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:39:56.307123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:56.308693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:56.324837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1013/2038] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:39:56.326233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe809a-fed8-44bb-8b58-df9b6e680625 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:56.339210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe809a-fed8-44bb-8b58-df9b6e680625 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:56.346491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c518b4b-1b20-4100-9be7-e95c741f50d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:56.347547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c518b4b-1b20-4100-9be7-e95c741f50d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.349858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c518b4b-1b20-4100-9be7-e95c741f50d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.350202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c518b4b-1b20-4100-9be7-e95c741f50d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.350951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c518b4b-1b20-4100-9be7-e95c741f50d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:56.352957 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c518b4b-1b20-4100-9be7-e95c741f50d8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:56.490936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1026/2039] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:56 2022] POST /identity/v3/projects => generated 357 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:56.493631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:56.504698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304bb9-8854-42ac-a21d-0fa95b8741f6 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:56.560685 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992fab3-8e43-4afb-8ac8-bb513496dac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:56.561373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992fab3-8e43-4afb-8ac8-bb513496dac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.561690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992fab3-8e43-4afb-8ac8-bb513496dac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.561972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992fab3-8e43-4afb-8ac8-bb513496dac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.562701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992fab3-8e43-4afb-8ac8-bb513496dac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:56.564620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992fab3-8e43-4afb-8ac8-bb513496dac9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:56.651443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1014/2040] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:56 2022] POST /identity/v3/users => generated 279 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:56.655634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c518b4b-1b20-4100-9be7-e95c741f50d8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:56.666735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c518b4b-1b20-4100-9be7-e95c741f50d8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:56.671464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f91b2-69ea-4e09-b697-64991a9f5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:56.672119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f91b2-69ea-4e09-b697-64991a9f5cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.672403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f91b2-69ea-4e09-b697-64991a9f5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.672680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f91b2-69ea-4e09-b697-64991a9f5cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.673468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f91b2-69ea-4e09-b697-64991a9f5cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:56.675104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f91b2-69ea-4e09-b697-64991a9f5cbd admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:56.685767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1027/2041] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:56.689936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992fab3-8e43-4afb-8ac8-bb513496dac9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:56.700220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992fab3-8e43-4afb-8ac8-bb513496dac9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:56.705624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e7618-4a53-4958-82d4-d2e5bd98e5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:56.706311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7618-4a53-4958-82d4-d2e5bd98e5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.706611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7618-4a53-4958-82d4-d2e5bd98e5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.706891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7618-4a53-4958-82d4-d2e5bd98e5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.707752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e7618-4a53-4958-82d4-d2e5bd98e5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:56.709347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e7618-4a53-4958-82d4-d2e5bd98e5a3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:56.719521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1015/2042] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:56.724346 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f91b2-69ea-4e09-b697-64991a9f5cbd admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:56.734445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f91b2-69ea-4e09-b697-64991a9f5cbd admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:56.739343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9065d0-6012-4129-811a-5bb8b4f6a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:56.740213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9065d0-6012-4129-811a-5bb8b4f6a20e admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.740496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9065d0-6012-4129-811a-5bb8b4f6a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.740816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9065d0-6012-4129-811a-5bb8b4f6a20e admin admin] PATH_INFO: `/v3/projects/ef96a08b651043cabbe5674e806a4227/users/bce75690c0e140579184f626d757e289/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.755345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9065d0-6012-4129-811a-5bb8b4f6a20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef96a08b651043cabbe5674e806a4227, user_id=bce75690c0e140579184f626d757e289, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:56.758054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9065d0-6012-4129-811a-5bb8b4f6a20e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:56.850553 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1028/2043] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:56 2022] PUT /identity/v3/projects/ef96a08b651043cabbe5674e806a4227/users/bce75690c0e140579184f626d757e289/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:56.862980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b411-2408-42ad-8e5c-e108efb3f459 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:56.863280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b411-2408-42ad-8e5c-e108efb3f459 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:56.863587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b411-2408-42ad-8e5c-e108efb3f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:56.901429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9dc9b411-2408-42ad-8e5c-e108efb3f459 None None] MFA Rules not processed for user `bce75690c0e140579184f626d757e289`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:56.902719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9dc9b411-2408-42ad-8e5c-e108efb3f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:57.020203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1016/2044] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:56 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:57.021634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9065d0-6012-4129-811a-5bb8b4f6a20e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:57.092539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9065d0-6012-4129-811a-5bb8b4f6a20e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:57.097662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845beff-4bdd-40d4-a66a-491ca144cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:57.098396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845beff-4bdd-40d4-a66a-491ca144cb23 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:57.098837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845beff-4bdd-40d4-a66a-491ca144cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:57.099122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845beff-4bdd-40d4-a66a-491ca144cb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:57.099812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845beff-4bdd-40d4-a66a-491ca144cb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:57.101727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845beff-4bdd-40d4-a66a-491ca144cb23 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:57.190887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1029/2045] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:39:57 2022] POST /identity/v3/projects => generated 355 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:39:57.194837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b411-2408-42ad-8e5c-e108efb3f459 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:57.205611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b411-2408-42ad-8e5c-e108efb3f459 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:57.261883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb479b-064c-4cbb-9ed8-a79f6a1e15b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:57.262591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb479b-064c-4cbb-9ed8-a79f6a1e15b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:57.262883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb479b-064c-4cbb-9ed8-a79f6a1e15b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:57.263163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb479b-064c-4cbb-9ed8-a79f6a1e15b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:57.263876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb479b-064c-4cbb-9ed8-a79f6a1e15b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:57.265874 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb479b-064c-4cbb-9ed8-a79f6a1e15b8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:57.367204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1017/2046] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:39:57 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:39:57.371424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845beff-4bdd-40d4-a66a-491ca144cb23 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:57.383043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845beff-4bdd-40d4-a66a-491ca144cb23 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:57.390065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd907-5f6c-4031-ba76-3e8c12fd2e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:57.390909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd907-5f6c-4031-ba76-3e8c12fd2e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:57.391296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd907-5f6c-4031-ba76-3e8c12fd2e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:57.391668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd907-5f6c-4031-ba76-3e8c12fd2e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:57.394236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd907-5f6c-4031-ba76-3e8c12fd2e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:57.396063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd907-5f6c-4031-ba76-3e8c12fd2e55 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:57.410661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1030/2047] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:57.415459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb479b-064c-4cbb-9ed8-a79f6a1e15b8 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:57.429581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb479b-064c-4cbb-9ed8-a79f6a1e15b8 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:57.443426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c2791-0013-447a-86cf-662ed1647430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:57.444433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2791-0013-447a-86cf-662ed1647430 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:57.444720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2791-0013-447a-86cf-662ed1647430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:57.445027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c2791-0013-447a-86cf-662ed1647430 admin admin] PATH_INFO: `/v3/projects/a21c3ed7240a43d2b4c94393ba3b0f5a/users/53ffb53bfc8c433b9b09e23ef36d6962/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:57.461214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c2791-0013-447a-86cf-662ed1647430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21c3ed7240a43d2b4c94393ba3b0f5a, user_id=53ffb53bfc8c433b9b09e23ef36d6962, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:57.465569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c2791-0013-447a-86cf-662ed1647430 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:57.571019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1018/2048] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:57 2022] PUT /identity/v3/projects/a21c3ed7240a43d2b4c94393ba3b0f5a/users/53ffb53bfc8c433b9b09e23ef36d6962/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:57.574969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd907-5f6c-4031-ba76-3e8c12fd2e55 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:57.584821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd907-5f6c-4031-ba76-3e8c12fd2e55 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:57.650692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee460-f0df-4846-aeaf-d96dad4c78e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:57.651363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee460-f0df-4846-aeaf-d96dad4c78e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:57.651650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee460-f0df-4846-aeaf-d96dad4c78e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:57.651929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee460-f0df-4846-aeaf-d96dad4c78e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:57.652658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ee460-f0df-4846-aeaf-d96dad4c78e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:57.654252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ee460-f0df-4846-aeaf-d96dad4c78e4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:57.664997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1031/2049] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:39:57.669033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c2791-0013-447a-86cf-662ed1647430 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:57.679936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c2791-0013-447a-86cf-662ed1647430 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:57.684606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:57.685497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:57.685741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:57.686021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] PATH_INFO: `/v3/projects/a21c3ed7240a43d2b4c94393ba3b0f5a/users/53ffb53bfc8c433b9b09e23ef36d6962/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:57.688122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21c3ed7240a43d2b4c94393ba3b0f5a, user_id=53ffb53bfc8c433b9b09e23ef36d6962, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:57.690861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:57.702164 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1019/2050] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:39:57 2022] PUT /identity/v3/projects/a21c3ed7240a43d2b4c94393ba3b0f5a/users/53ffb53bfc8c433b9b09e23ef36d6962/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:39:57.712615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93901-3259-41e0-a5df-789e5f15d091 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:57.712926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93901-3259-41e0-a5df-789e5f15d091 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:57.713210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93901-3259-41e0-a5df-789e5f15d091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:57.759829 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-25b93901-3259-41e0-a5df-789e5f15d091 None None] MFA Rules not processed for user `53ffb53bfc8c433b9b09e23ef36d6962`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:39:57.761120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-25b93901-3259-41e0-a5df-789e5f15d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:57.838066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1032/2051] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:39:57 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:39:57.875848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:57.877963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:57.935360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11bdc2-5c14-4e73-9cc7-049b8d14c248 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:57.939056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1cf54-a411-4406-91f9-f220bef429ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:57.939742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1cf54-a411-4406-91f9-f220bef429ce service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:57.940030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1cf54-a411-4406-91f9-f220bef429ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:57.940312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1cf54-a411-4406-91f9-f220bef429ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:57.949857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1cf54-a411-4406-91f9-f220bef429ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:57.951032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1cf54-a411-4406-91f9-f220bef429ce service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:57.961320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1020/2052] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:57 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:58.255668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b93901-3259-41e0-a5df-789e5f15d091 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:58.265108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b93901-3259-41e0-a5df-789e5f15d091 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:58.269307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:58.269939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:58.270224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:58.270502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:58.327705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:58.329181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:58.338707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1033/2053] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:58.958148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1cf54-a411-4406-91f9-f220bef429ce service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:58.966914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1cf54-a411-4406-91f9-f220bef429ce service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:58.970702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:58.971349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:58.971634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:58.971925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:58.973697 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:59.042325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:59.043983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:59.054949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1021/2054] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:39:59.606370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:59.609434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:59.689944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e5b2-8c7c-493e-aac4-df08e60538b5 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:59.695141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:59.696072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:59.696358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:59.696636 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] PATH_INFO: `/v3/users/da7d46674360478094aac0bb378819e4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:59.697864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7d46674360478094aac0bb378819e4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:59.699885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:59.771020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:39:59.774809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:39:59.789518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd7980-f570-4b8d-b724-3840ab4a3024 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:39:59.794520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:39:59.795447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:39:59.795738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:39:59.796011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] PATH_INFO: `/v3/users/a3de084ad4bc44239b89fab61a60dcb9` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:39:59.797369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3de084ad4bc44239b89fab61a60dcb9)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:39:59.799356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:39:59.881605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7d46674360478094aac0bb378819e4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:59.888390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7d46674360478094aac0bb378819e4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:59.889305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7d46674360478094aac0bb378819e4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:39:59.890006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7d46674360478094aac0bb378819e4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.000033 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-29342bb6-8d33-43d4-8689-70e17019ff41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7d46674360478094aac0bb378819e4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.003750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3de084ad4bc44239b89fab61a60dcb9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.007113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3de084ad4bc44239b89fab61a60dcb9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.011932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3de084ad4bc44239b89fab61a60dcb9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.012568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3de084ad4bc44239b89fab61a60dcb9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.019252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1034/2055] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:59 2022] DELETE /identity/v3/users/da7d46674360478094aac0bb378819e4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:00.023727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426770b9-8bee-4f99-98af-78da7d24a660 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:00.028098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426770b9-8bee-4f99-98af-78da7d24a660 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:00.028098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426770b9-8bee-4f99-98af-78da7d24a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:00.042165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-426770b9-8bee-4f99-98af-78da7d24a660 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:00.044994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-426770b9-8bee-4f99-98af-78da7d24a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:00.074253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3de084ad4bc44239b89fab61a60dcb9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.092397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1022/2056] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:39:59 2022] DELETE /identity/v3/users/a3de084ad4bc44239b89fab61a60dcb9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:40:00.104534 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1035/2057] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:00.117027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:00.118580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:00.182848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916320d-ad58-41f6-b342-6e55c993d0a5 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:00.188952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e73cd0-33cc-4bff-9458-721a80a182b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:00.190755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73cd0-33cc-4bff-9458-721a80a182b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:00.191048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73cd0-33cc-4bff-9458-721a80a182b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:00.191331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73cd0-33cc-4bff-9458-721a80a182b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:00.298961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73cd0-33cc-4bff-9458-721a80a182b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:00.300485 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73cd0-33cc-4bff-9458-721a80a182b3 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:00.310440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1023/2058] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:00.395780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426770b9-8bee-4f99-98af-78da7d24a660 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:00.397385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-426770b9-8bee-4f99-98af-78da7d24a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:00.411182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426770b9-8bee-4f99-98af-78da7d24a660 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:00.418782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:00.419778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:00.420072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:00.420353 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] PATH_INFO: `/v3/projects/c2364720daae4bf48b5408c3047da3b9` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:00.421695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2364720daae4bf48b5408c3047da3b9)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:00.424173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:00.528134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2364720daae4bf48b5408c3047da3b9', 'request_id': 'req-8f7e45de-e237-4b1c-bab8-98adce4b4b17'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.605142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2364720daae4bf48b5408c3047da3b9', 'request_id': 'req-8f7e45de-e237-4b1c-bab8-98adce4b4b17'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.611975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2364720daae4bf48b5408c3047da3b9', 'request_id': 'req-8f7e45de-e237-4b1c-bab8-98adce4b4b17'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.625039 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] The token cache is being invalidate because project c2364720daae4bf48b5408c3047da3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:00.625744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.626950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8f7e45de-e237-4b1c-bab8-98adce4b4b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:00.629757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1036/2059] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:00 2022] DELETE /identity/v3/projects/c2364720daae4bf48b5408c3047da3b9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:00.636925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce23b26-e1cc-4f8e-b9f6-c3b03772d587 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:00.637210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce23b26-e1cc-4f8e-b9f6-c3b03772d587 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:00.637541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce23b26-e1cc-4f8e-b9f6-c3b03772d587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:00.661133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-dce23b26-e1cc-4f8e-b9f6-c3b03772d587 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:00.662617 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-dce23b26-e1cc-4f8e-b9f6-c3b03772d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:00.731323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1024/2060] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:00.745897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404cec5-b62a-45fb-a818-e55afbe62c32 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:00.745897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404cec5-b62a-45fb-a818-e55afbe62c32 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:00.745897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404cec5-b62a-45fb-a818-e55afbe62c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:00.760490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-0404cec5-b62a-45fb-a818-e55afbe62c32 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:00.761760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0404cec5-b62a-45fb-a818-e55afbe62c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:00.771126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1037/2061] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:00.775586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce23b26-e1cc-4f8e-b9f6-c3b03772d587 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:00.786306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce23b26-e1cc-4f8e-b9f6-c3b03772d587 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:00.791777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404cec5-b62a-45fb-a818-e55afbe62c32 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:00.793043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:00.793987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0404cec5-b62a-45fb-a818-e55afbe62c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:00.797583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:00.797903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:00.799063 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:00.800698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:00.801022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:00.802667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:00.816693 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404cec5-b62a-45fb-a818-e55afbe62c32 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:00.818463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1025/2062] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:00.822899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:00.839240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:00.840288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:00.840620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:00.840879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] PATH_INFO: `/v3/projects/e1e02efa66c444578517a22a71b0c6ae` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:00.845921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e02efa66c444578517a22a71b0c6ae)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:00.845921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:00.846444 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b011b-4cf9-4662-8043-dc6f2c7381e9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:00.850495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5bb6d-a2b9-4a59-8e6c-fe28f750c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:00.851402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bb6d-a2b9-4a59-8e6c-fe28f750c25b admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:00.851692 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bb6d-a2b9-4a59-8e6c-fe28f750c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:00.852005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5bb6d-a2b9-4a59-8e6c-fe28f750c25b admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:00.852713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5bb6d-a2b9-4a59-8e6c-fe28f750c25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:00.854628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5bb6d-a2b9-4a59-8e6c-fe28f750c25b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:00.953300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1026/2063] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:00 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:40:00.954305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5bb6d-a2b9-4a59-8e6c-fe28f750c25b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:00.961637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e02efa66c444578517a22a71b0c6ae', 'request_id': 'req-3c7315de-bc83-462d-bdb1-fe5bd0055376'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.027607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5bb6d-a2b9-4a59-8e6c-fe28f750c25b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:01.032727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:01.034048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:01.034823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:01.034823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:01.035393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:01.037296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:01.050952 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e02efa66c444578517a22a71b0c6ae', 'request_id': 'req-3c7315de-bc83-462d-bdb1-fe5bd0055376'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.058934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e02efa66c444578517a22a71b0c6ae', 'request_id': 'req-3c7315de-bc83-462d-bdb1-fe5bd0055376'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.071039 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] The token cache is being invalidate because project e1e02efa66c444578517a22a71b0c6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:01.071333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.072098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.074079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1038/2064] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:00 2022] DELETE /identity/v3/projects/e1e02efa66c444578517a22a71b0c6ae => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:01.081719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:01.083259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:01.146758 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7315de-bc83-462d-bdb1-fe5bd0055376 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:01.152178 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:01.153028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:01.153312 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:01.153586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] PATH_INFO: `/v3/users/25c6339aed9846b7b4538e92ef3f0ee7` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:01.154817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c6339aed9846b7b4538e92ef3f0ee7)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:01.157079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:01.226514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1027/2065] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:00 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:40:01.227562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:01.229170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:01.241339 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bb3d-575c-49f5-875e-35c8b842fb4c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:01.246149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6904-e13a-4fd3-a7c4-7531fc136b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:01.246892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6904-e13a-4fd3-a7c4-7531fc136b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:01.255521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6904-e13a-4fd3-a7c4-7531fc136b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:01.255521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa6904-e13a-4fd3-a7c4-7531fc136b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:01.255521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa6904-e13a-4fd3-a7c4-7531fc136b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:01.255521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa6904-e13a-4fd3-a7c4-7531fc136b7f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:01.259503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1028/2066] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:01.263511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6904-e13a-4fd3-a7c4-7531fc136b7f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:01.277217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa6904-e13a-4fd3-a7c4-7531fc136b7f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:01.282326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9063ac-594b-489a-8a22-a9f44a003da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:01.283656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9063ac-594b-489a-8a22-a9f44a003da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:01.284273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9063ac-594b-489a-8a22-a9f44a003da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:01.284273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9063ac-594b-489a-8a22-a9f44a003da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:01.284940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9063ac-594b-489a-8a22-a9f44a003da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:01.286580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9063ac-594b-489a-8a22-a9f44a003da4 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:01.304149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1029/2067] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:01.307248 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9063ac-594b-489a-8a22-a9f44a003da4 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:01.318072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9063ac-594b-489a-8a22-a9f44a003da4 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:01.325274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e91c6-5cca-4e23-ba5a-c34c11c3eac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:01.326819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e91c6-5cca-4e23-ba5a-c34c11c3eac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:01.327118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e91c6-5cca-4e23-ba5a-c34c11c3eac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:01.327390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e91c6-5cca-4e23-ba5a-c34c11c3eac1 admin admin] PATH_INFO: `/v3/projects/78547cd37d15479397107643e766fcb4/users/50998395da9a417eaa555e714c998496/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:01.344762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e91c6-5cca-4e23-ba5a-c34c11c3eac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78547cd37d15479397107643e766fcb4, user_id=50998395da9a417eaa555e714c998496, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:01.348243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e91c6-5cca-4e23-ba5a-c34c11c3eac1 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:01.379569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c6339aed9846b7b4538e92ef3f0ee7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.386892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c6339aed9846b7b4538e92ef3f0ee7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.387654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c6339aed9846b7b4538e92ef3f0ee7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.388299 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c6339aed9846b7b4538e92ef3f0ee7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.434315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1030/2068] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:01 2022] PUT /identity/v3/projects/78547cd37d15479397107643e766fcb4/users/50998395da9a417eaa555e714c998496/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:01.440584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc3bb-bb34-4684-a4fb-a05364607d84 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:01.440875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc3bb-bb34-4684-a4fb-a05364607d84 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:01.441161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc3bb-bb34-4684-a4fb-a05364607d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:01.458429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-082cc3bb-bb34-4684-a4fb-a05364607d84 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:01.459671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-082cc3bb-bb34-4684-a4fb-a05364607d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:01.473630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c6339aed9846b7b4538e92ef3f0ee7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:01.491437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1039/2069] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:01 2022] DELETE /identity/v3/users/25c6339aed9846b7b4538e92ef3f0ee7 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:40:01.523825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1031/2070] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:01.539824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:01.541669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:01.613422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae50792-0b2a-4bc5-adfe-cf06bb60c291 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:01.617623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fffe5-7a8b-4086-ab94-07558058e236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:01.618323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fffe5-7a8b-4086-ab94-07558058e236 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:01.618652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fffe5-7a8b-4086-ab94-07558058e236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:01.618932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fffe5-7a8b-4086-ab94-07558058e236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:01.686898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fffe5-7a8b-4086-ab94-07558058e236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:01.691495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fffe5-7a8b-4086-ab94-07558058e236 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:01.710570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1040/2071] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:40:02.003627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cc3bb-bb34-4684-a4fb-a05364607d84 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:02.005846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-082cc3bb-bb34-4684-a4fb-a05364607d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:02.039010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cc3bb-bb34-4684-a4fb-a05364607d84 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:02.042895 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:02.044024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:02.044489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:02.044946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] PATH_INFO: `/v3/projects/510685b846a54f48ba6747990ad35a29` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:02.046425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510685b846a54f48ba6747990ad35a29)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:02.049226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:02.182240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510685b846a54f48ba6747990ad35a29', 'request_id': 'req-435aedaf-db61-4a6a-a147-92fa99d3e6f5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.257032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510685b846a54f48ba6747990ad35a29', 'request_id': 'req-435aedaf-db61-4a6a-a147-92fa99d3e6f5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.263218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510685b846a54f48ba6747990ad35a29', 'request_id': 'req-435aedaf-db61-4a6a-a147-92fa99d3e6f5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.274755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] The token cache is being invalidate because project 510685b846a54f48ba6747990ad35a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:02.275049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.275700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.277257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1032/2072] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:02 2022] DELETE /identity/v3/projects/510685b846a54f48ba6747990ad35a29 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:02.281457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fffe5-7a8b-4086-ab94-07558058e236 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:02.292556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fffe5-7a8b-4086-ab94-07558058e236 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:02.350216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:02.351815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:02.351815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:02.351815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] PATH_INFO: `/v3/users/ebb0611011354979ad51ee17858a1c84` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:02.352947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb0611011354979ad51ee17858a1c84)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:02.354911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:02.549969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb0611011354979ad51ee17858a1c84'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.556626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb0611011354979ad51ee17858a1c84'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.557292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb0611011354979ad51ee17858a1c84'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.557984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb0611011354979ad51ee17858a1c84'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.665348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4320af20-e406-4d8f-93de-cda3d247b1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb0611011354979ad51ee17858a1c84'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:02.683124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1041/2073] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:02 2022] DELETE /identity/v3/users/ebb0611011354979ad51ee17858a1c84 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:03.431331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:03.433618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:03.451117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aedaf-db61-4a6a-a147-92fa99d3e6f5 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:03.560472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:03.561367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:03.561657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:03.561940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] PATH_INFO: `/v3/projects/06a3cefec54e416db0706554ca8ccf6f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:03.564154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a3cefec54e416db0706554ca8ccf6f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:03.566399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:03.665560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a3cefec54e416db0706554ca8ccf6f', 'request_id': 'req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:03.730945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a3cefec54e416db0706554ca8ccf6f', 'request_id': 'req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:03.738702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a3cefec54e416db0706554ca8ccf6f', 'request_id': 'req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:03.751102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] The token cache is being invalidate because project 06a3cefec54e416db0706554ca8ccf6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:03.751902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:03.752919 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-477c8e62-bd9d-47bd-9c02-efd60b0dfb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:03.754943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1033/2074] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:03 2022] DELETE /identity/v3/projects/06a3cefec54e416db0706554ca8ccf6f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:03.760000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22784d-aafa-4c44-bc83-bee4217e81cf None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:03.760809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22784d-aafa-4c44-bc83-bee4217e81cf None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:03.760809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22784d-aafa-4c44-bc83-bee4217e81cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:03.786333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-6a22784d-aafa-4c44-bc83-bee4217e81cf None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:03.788168 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6a22784d-aafa-4c44-bc83-bee4217e81cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:03.856705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1042/2075] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:03.865566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00847c4-c1f7-4332-9c46-319fe0addd05 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:03.866152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00847c4-c1f7-4332-9c46-319fe0addd05 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:03.866653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00847c4-c1f7-4332-9c46-319fe0addd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:03.886765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b00847c4-c1f7-4332-9c46-319fe0addd05 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:03.888337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b00847c4-c1f7-4332-9c46-319fe0addd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:03.899888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1034/2076] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:03.904130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22784d-aafa-4c44-bc83-bee4217e81cf None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:03.915099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22784d-aafa-4c44-bc83-bee4217e81cf None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:03.920685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:03.921472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:03.921832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:03.922183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:03.922970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:03.923294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:03.926871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:03.938378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1043/2077] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:03.943579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00847c4-c1f7-4332-9c46-319fe0addd05 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:03.954328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00847c4-c1f7-4332-9c46-319fe0addd05 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:03.959856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4523d-b057-4bdf-a99f-0f62eb21afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:03.960513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4523d-b057-4bdf-a99f-0f62eb21afee admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:03.960800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4523d-b057-4bdf-a99f-0f62eb21afee admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:03.961080 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4523d-b057-4bdf-a99f-0f62eb21afee admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:03.961776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4523d-b057-4bdf-a99f-0f62eb21afee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:03.963768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4523d-b057-4bdf-a99f-0f62eb21afee admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:04.100061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1035/2078] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:03 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:04.104320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:04.115459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945ff5e-1ca1-4386-a02c-6f41ef5e7b2a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:04.183987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1d3b-85c8-4bab-82e8-24a986235360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:04.184796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1d3b-85c8-4bab-82e8-24a986235360 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:04.185326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1d3b-85c8-4bab-82e8-24a986235360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:04.185679 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1d3b-85c8-4bab-82e8-24a986235360 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:04.186472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e1d3b-85c8-4bab-82e8-24a986235360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:04.188604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e1d3b-85c8-4bab-82e8-24a986235360 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:04.256219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1044/2079] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:04 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:04.257002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4523d-b057-4bdf-a99f-0f62eb21afee admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:04.269112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4523d-b057-4bdf-a99f-0f62eb21afee admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:04.275523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b4f6-9c75-4e31-a31f-60a671080b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:04.276282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b4f6-9c75-4e31-a31f-60a671080b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:04.276675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b4f6-9c75-4e31-a31f-60a671080b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:04.277173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b4f6-9c75-4e31-a31f-60a671080b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:04.278166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b4f6-9c75-4e31-a31f-60a671080b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:04.280069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b4f6-9c75-4e31-a31f-60a671080b60 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:04.294228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1036/2080] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:04.298805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1d3b-85c8-4bab-82e8-24a986235360 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:04.311014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1d3b-85c8-4bab-82e8-24a986235360 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:04.317589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43127b82-e635-4c25-8f2d-d8e2aae9160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:04.319185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43127b82-e635-4c25-8f2d-d8e2aae9160d admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:04.319266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43127b82-e635-4c25-8f2d-d8e2aae9160d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:04.319637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43127b82-e635-4c25-8f2d-d8e2aae9160d admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:04.320608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43127b82-e635-4c25-8f2d-d8e2aae9160d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:04.322616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43127b82-e635-4c25-8f2d-d8e2aae9160d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:04.342344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b4f6-9c75-4e31-a31f-60a671080b60 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:04.344302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1045/2081] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:04.355595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b4f6-9c75-4e31-a31f-60a671080b60 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:04.362427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:04.363832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:04.364119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:04.364397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] PATH_INFO: `/v3/projects/62196748a87f41e6bdfba566208b543f/users/2523ef3db2a74ff69d2689a648188ee4/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:04.384493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62196748a87f41e6bdfba566208b543f, user_id=2523ef3db2a74ff69d2689a648188ee4, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:04.387213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:04.463360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1037/2082] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:04 2022] PUT /identity/v3/projects/62196748a87f41e6bdfba566208b543f/users/2523ef3db2a74ff69d2689a648188ee4/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:04.473960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47c0a-3558-4db2-8d77-1b93dae4f26c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:04.474259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47c0a-3558-4db2-8d77-1b93dae4f26c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:04.474609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf47c0a-3558-4db2-8d77-1b93dae4f26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:04.505631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-abf47c0a-3558-4db2-8d77-1b93dae4f26c None None] MFA Rules not processed for user `2523ef3db2a74ff69d2689a648188ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:04.510671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-abf47c0a-3558-4db2-8d77-1b93dae4f26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:04.662720 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1046/2083] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:04.682821 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:04.685003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:04.780402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7001489-be9e-4eed-b5a9-019ccfe3eb6c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:04.784179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:04.785033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:04.785470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:04.785940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:04.794835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:04.796459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:04.807227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1038/2084] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:04.836529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf47c0a-3558-4db2-8d77-1b93dae4f26c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:04.936066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf47c0a-3558-4db2-8d77-1b93dae4f26c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:04.943435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:04.944994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:04.945540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:04.948465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] PATH_INFO: `/v3/users/2523ef3db2a74ff69d2689a648188ee4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:04.950964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2523ef3db2a74ff69d2689a648188ee4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:04.956114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:05.088458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:05.091033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:05.106902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795e331-a036-418f-8ff0-5e4060c965bd service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:05.112873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:05.113838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:05.114123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:05.114410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] PATH_INFO: `/v3/users/3bb45ab7b23c444ea91a74695da62de4` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:05.115669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb45ab7b23c444ea91a74695da62de4)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:05.117642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:05.272025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2523ef3db2a74ff69d2689a648188ee4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.280968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2523ef3db2a74ff69d2689a648188ee4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.283461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2523ef3db2a74ff69d2689a648188ee4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.284202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2523ef3db2a74ff69d2689a648188ee4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.403058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb45ab7b23c444ea91a74695da62de4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.403964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb45ab7b23c444ea91a74695da62de4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.415358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb45ab7b23c444ea91a74695da62de4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.416237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb45ab7b23c444ea91a74695da62de4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.428213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d32f53ae-7d40-445c-b99f-fecd3804bc39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2523ef3db2a74ff69d2689a648188ee4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.447690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1047/2085] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:04 2022] DELETE /identity/v3/users/2523ef3db2a74ff69d2689a648188ee4 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:05.452118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a854b6-cdef-430c-9b90-ea3a399fb96c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:05.452341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a854b6-cdef-430c-9b90-ea3a399fb96c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:05.452630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a854b6-cdef-430c-9b90-ea3a399fb96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:05.474007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-31a854b6-cdef-430c-9b90-ea3a399fb96c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:05.475274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-31a854b6-cdef-430c-9b90-ea3a399fb96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:05.548598 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-88c71bad-ddbc-4820-a8b5-3ba98b897157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb45ab7b23c444ea91a74695da62de4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:05.554593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1048/2086] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:05.563892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a854b6-cdef-430c-9b90-ea3a399fb96c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:05.566278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-31a854b6-cdef-430c-9b90-ea3a399fb96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:05.573606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1039/2087] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:05 2022] DELETE /identity/v3/users/3bb45ab7b23c444ea91a74695da62de4 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:05.587177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaf0c5-37ed-4334-9b9d-b7d6c91e8a5d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:05.587177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaf0c5-37ed-4334-9b9d-b7d6c91e8a5d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:05.587177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaf0c5-37ed-4334-9b9d-b7d6c91e8a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:05.609642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-69aaf0c5-37ed-4334-9b9d-b7d6c91e8a5d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:05.612488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-69aaf0c5-37ed-4334-9b9d-b7d6c91e8a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:05.670158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a854b6-cdef-430c-9b90-ea3a399fb96c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:05.715804 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1040/2088] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:05.723329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaf0c5-37ed-4334-9b9d-b7d6c91e8a5d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:05.787103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:05.788152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:05.788642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:05.789125 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:05.802902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:05.806857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:05.820573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1049/2089] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:40:05.823174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaf0c5-37ed-4334-9b9d-b7d6c91e8a5d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:05.827329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:05.828350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:05.828655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:05.828936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:05.840436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:05.841897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:05.853137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1041/2090] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:06.504533 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:06.506106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:06.538984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a4711-7a72-483f-b591-126fb94b31cc service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:06.543724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:06.544569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:06.544849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:06.545121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] PATH_INFO: `/v3/projects/62196748a87f41e6bdfba566208b543f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:06.546309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62196748a87f41e6bdfba566208b543f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:06.548268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:06.569544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:06.569544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:06.590386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba1f8f-2e8b-45e7-9e41-f144301be3cc service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:06.596287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:06.599475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:06.599475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:06.599475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] PATH_INFO: `/v3/projects/ce5c3775c723407e99f26881bd680f8c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:06.601210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5c3775c723407e99f26881bd680f8c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:06.603692 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:06.695897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62196748a87f41e6bdfba566208b543f', 'request_id': 'req-6ae5df05-980c-489d-9fd1-bcf529369451'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.754926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5c3775c723407e99f26881bd680f8c', 'request_id': 'req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.866255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62196748a87f41e6bdfba566208b543f', 'request_id': 'req-6ae5df05-980c-489d-9fd1-bcf529369451'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.882284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62196748a87f41e6bdfba566208b543f', 'request_id': 'req-6ae5df05-980c-489d-9fd1-bcf529369451'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.918969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] The token cache is being invalidate because project 62196748a87f41e6bdfba566208b543f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:06.919397 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.920167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5c3775c723407e99f26881bd680f8c', 'request_id': 'req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.920575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ae5df05-980c-489d-9fd1-bcf529369451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.927304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1050/2091] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:06 2022] DELETE /identity/v3/projects/62196748a87f41e6bdfba566208b543f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:06.929203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5c3775c723407e99f26881bd680f8c', 'request_id': 'req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.929768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35cbed-fea9-41f7-a993-a5a26d83f70d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:06.930763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35cbed-fea9-41f7-a993-a5a26d83f70d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:06.930763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35cbed-fea9-41f7-a993-a5a26d83f70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:06.955153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] The token cache is being invalidate because project ce5c3775c723407e99f26881bd680f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:06.956071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.958728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-be35cbed-fea9-41f7-a993-a5a26d83f70d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:06.959152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:06.960384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-be35cbed-fea9-41f7-a993-a5a26d83f70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:06.963669 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1042/2092] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:06 2022] DELETE /identity/v3/projects/ce5c3775c723407e99f26881bd680f8c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:06.967593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:06.971328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:07.102584 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1051/2093] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:07.111840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd180-c62d-4359-97fd-f4d11fa27fa8 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:07.112426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd180-c62d-4359-97fd-f4d11fa27fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:07.112862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd180-c62d-4359-97fd-f4d11fa27fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:07.125107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0854-98b1-440d-a046-9ce4bd7be9e9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:07.132492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:07.133558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:07.133852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:07.134750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] PATH_INFO: `/v3/users/220e0a52eead46768a1bb7007b78692d` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:07.157259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-cebdd180-c62d-4359-97fd-f4d11fa27fa8 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:07.158197 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=220e0a52eead46768a1bb7007b78692d)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:07.159575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cebdd180-c62d-4359-97fd-f4d11fa27fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:07.163017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:07.186601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1052/2094] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:07.187998 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdd180-c62d-4359-97fd-f4d11fa27fa8 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:07.205288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdd180-c62d-4359-97fd-f4d11fa27fa8 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:07.217164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:07.223018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:07.223500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:07.223971 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:07.224927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:07.225461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:07.227327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:07.245666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1053/2095] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:07.246990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:07.260215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc627b3-3e1b-48d1-84f2-106872586641 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:07.280283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:07.280977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:07.281307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:07.281533 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:07.287171 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:07.291130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:07.366060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220e0a52eead46768a1bb7007b78692d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:07.366816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220e0a52eead46768a1bb7007b78692d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:07.375394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220e0a52eead46768a1bb7007b78692d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:07.376309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220e0a52eead46768a1bb7007b78692d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:07.409372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1054/2096] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:07 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:07.414001 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:07.415831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:07.484934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220e0a52eead46768a1bb7007b78692d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:07.523013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1043/2097] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:06 2022] DELETE /identity/v3/users/220e0a52eead46768a1bb7007b78692d => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:07.528225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4a21-ffa1-4846-b982-a486bfc2ac47 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:07.605677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66949701-c779-4a11-a956-104a5e62a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:07.606729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949701-c779-4a11-a956-104a5e62a6af admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:07.606915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949701-c779-4a11-a956-104a5e62a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:07.607310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949701-c779-4a11-a956-104a5e62a6af admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:07.608014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66949701-c779-4a11-a956-104a5e62a6af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:07.610186 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66949701-c779-4a11-a956-104a5e62a6af admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:07.719960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1055/2098] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:07 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:07.724302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:07.734265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd0db-4d52-4abb-9331-49ae6a5ea0aa admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:07.739503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2cb13-1399-452a-81e4-d574c8897619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:07.740172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2cb13-1399-452a-81e4-d574c8897619 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:07.740459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2cb13-1399-452a-81e4-d574c8897619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:07.740739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2cb13-1399-452a-81e4-d574c8897619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:07.749263 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2cb13-1399-452a-81e4-d574c8897619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:07.753122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2cb13-1399-452a-81e4-d574c8897619 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:07.780320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1044/2099] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:07.784823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66949701-c779-4a11-a956-104a5e62a6af admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:07.799933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66949701-c779-4a11-a956-104a5e62a6af admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:07.813033 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccb5e5-4e94-4a7e-93f2-3bcd46722c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:07.828645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb5e5-4e94-4a7e-93f2-3bcd46722c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:07.829210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb5e5-4e94-4a7e-93f2-3bcd46722c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:07.829749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb5e5-4e94-4a7e-93f2-3bcd46722c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:07.830960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccb5e5-4e94-4a7e-93f2-3bcd46722c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:07.839660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccb5e5-4e94-4a7e-93f2-3bcd46722c64 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:07.859169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1056/2100] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:07.863515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2cb13-1399-452a-81e4-d574c8897619 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:07.874053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2cb13-1399-452a-81e4-d574c8897619 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:07.879834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:07.884626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:07.884626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:07.884626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] PATH_INFO: `/v3/projects/21293c6d668a443199fad85681f13cf5/users/82bcd0d11bc346858946b46d4b65c047/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:07.905566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21293c6d668a443199fad85681f13cf5, user_id=82bcd0d11bc346858946b46d4b65c047, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:07.908828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:07.995139 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1045/2101] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:07 2022] PUT /identity/v3/projects/21293c6d668a443199fad85681f13cf5/users/82bcd0d11bc346858946b46d4b65c047/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:08.000318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec19c-f167-4d09-bea5-2fb1d578e777 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.000622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec19c-f167-4d09-bea5-2fb1d578e777 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.000911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec19c-f167-4d09-bea5-2fb1d578e777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.042673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-017ec19c-f167-4d09-bea5-2fb1d578e777 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:08.053811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-017ec19c-f167-4d09-bea5-2fb1d578e777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:08.144610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1057/2102] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:08.155961 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:08.159038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:08.193727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ec19c-f167-4d09-bea5-2fb1d578e777 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:08.195159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-017ec19c-f167-4d09-bea5-2fb1d578e777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:08.213507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ec19c-f167-4d09-bea5-2fb1d578e777 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:08.221907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:08.225717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.226182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.226999 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] PATH_INFO: `/v3/projects/0971668c835e49cfa7be77e606d9c682` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.229802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0971668c835e49cfa7be77e606d9c682)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:08.232367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:08.359545 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0971668c835e49cfa7be77e606d9c682', 'request_id': 'req-f003a728-1d24-4b75-935c-025a9637a24e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:08.376763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df182b42-85d1-46d7-ad37-8bfc40a86e18 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:08.441396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0971668c835e49cfa7be77e606d9c682', 'request_id': 'req-f003a728-1d24-4b75-935c-025a9637a24e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:08.448288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0971668c835e49cfa7be77e606d9c682', 'request_id': 'req-f003a728-1d24-4b75-935c-025a9637a24e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:08.463701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:08.464285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] The token cache is being invalidate because project 0971668c835e49cfa7be77e606d9c682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:08.464591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:08.465309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f003a728-1d24-4b75-935c-025a9637a24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:08.466009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.466792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.467226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.468184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1058/2103] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:08 2022] DELETE /identity/v3/projects/0971668c835e49cfa7be77e606d9c682 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:40:08.471203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:08.477624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca16e-28c5-414a-b042-ea69445128f2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.480919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca16e-28c5-414a-b042-ea69445128f2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.481341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca16e-28c5-414a-b042-ea69445128f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.503645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-13aca16e-28c5-414a-b042-ea69445128f2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:08.505066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-13aca16e-28c5-414a-b042-ea69445128f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:08.616361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:08.617954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:08.622574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1059/2104] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:08.630887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54509dd-dc4a-4575-befc-5a8d692331b4 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.631145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54509dd-dc4a-4575-befc-5a8d692331b4 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.631423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54509dd-dc4a-4575-befc-5a8d692331b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.635848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1046/2105] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:08.655535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f54509dd-dc4a-4575-befc-5a8d692331b4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:08.658686 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f54509dd-dc4a-4575-befc-5a8d692331b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:08.670728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1060/2106] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:08.673101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:08.685759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06968848-0938-4358-94fd-2527aaa47512 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:08.695513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69a51d-2e46-4e3f-88f1-e9ab58d7002e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:08.696262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a51d-2e46-4e3f-88f1-e9ab58d7002e admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.696555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a51d-2e46-4e3f-88f1-e9ab58d7002e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.696838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69a51d-2e46-4e3f-88f1-e9ab58d7002e admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.697589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69a51d-2e46-4e3f-88f1-e9ab58d7002e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:08.697956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69a51d-2e46-4e3f-88f1-e9ab58d7002e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:08.699606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69a51d-2e46-4e3f-88f1-e9ab58d7002e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:08.714957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1047/2107] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:08.718500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54509dd-dc4a-4575-befc-5a8d692331b4 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:08.739525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54509dd-dc4a-4575-befc-5a8d692331b4 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:08.746823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d4933-dc9c-4a2f-aac6-ab6796942a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:08.747503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4933-dc9c-4a2f-aac6-ab6796942a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.747792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4933-dc9c-4a2f-aac6-ab6796942a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.748073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d4933-dc9c-4a2f-aac6-ab6796942a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.748797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d4933-dc9c-4a2f-aac6-ab6796942a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:08.753538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d4933-dc9c-4a2f-aac6-ab6796942a70 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:08.812903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe54c4-ca75-4dab-a132-2e51fb8cd966 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.813366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe54c4-ca75-4dab-a132-2e51fb8cd966 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.813526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe54c4-ca75-4dab-a132-2e51fb8cd966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.846759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-14fe54c4-ca75-4dab-a132-2e51fb8cd966 None None] MFA Rules not processed for user `50998395da9a417eaa555e714c998496`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:08.848496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-14fe54c4-ca75-4dab-a132-2e51fb8cd966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:08.853212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1061/2108] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:08 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:08.854271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d4933-dc9c-4a2f-aac6-ab6796942a70 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:08.955174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d4933-dc9c-4a2f-aac6-ab6796942a70 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:08.955890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1048/2109] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:08.962667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe54c4-ca75-4dab-a132-2e51fb8cd966 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:08.964321 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-14fe54c4-ca75-4dab-a132-2e51fb8cd966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:08.972298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c5d03-941d-4398-a804-8097da281022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:08.973788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5d03-941d-4398-a804-8097da281022 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:08.974240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5d03-941d-4398-a804-8097da281022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:08.977027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5d03-941d-4398-a804-8097da281022 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:08.977027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c5d03-941d-4398-a804-8097da281022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:08.979421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c5d03-941d-4398-a804-8097da281022 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:09.049763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe54c4-ca75-4dab-a132-2e51fb8cd966 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:09.056324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d526e1b-75e6-4d77-b8be-01436c62e745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:09.061156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526e1b-75e6-4d77-b8be-01436c62e745 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:09.061156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526e1b-75e6-4d77-b8be-01436c62e745 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:09.061156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d526e1b-75e6-4d77-b8be-01436c62e745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:09.068875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d526e1b-75e6-4d77-b8be-01436c62e745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:09.070662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d526e1b-75e6-4d77-b8be-01436c62e745 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:09.089351 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1062/2110] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:08 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:09.090846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1049/2111] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:09.092647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c5d03-941d-4398-a804-8097da281022 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:09.110157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c5d03-941d-4398-a804-8097da281022 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:09.116131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc5f87-0bbb-41ec-bd06-a1b12a7791cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:09.116805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc5f87-0bbb-41ec-bd06-a1b12a7791cd admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:09.121503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc5f87-0bbb-41ec-bd06-a1b12a7791cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:09.121503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc5f87-0bbb-41ec-bd06-a1b12a7791cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:09.121503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc5f87-0bbb-41ec-bd06-a1b12a7791cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:09.121503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc5f87-0bbb-41ec-bd06-a1b12a7791cd admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:09.135087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1063/2112] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:09.138864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d526e1b-75e6-4d77-b8be-01436c62e745 service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:09.167755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d526e1b-75e6-4d77-b8be-01436c62e745 service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:09.181312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9c5f5-3ef9-41a2-bf2e-f1fbac5e6529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:09.184124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c5f5-3ef9-41a2-bf2e-f1fbac5e6529 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:09.184404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c5f5-3ef9-41a2-bf2e-f1fbac5e6529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:09.184680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c5f5-3ef9-41a2-bf2e-f1fbac5e6529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:09.185421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9c5f5-3ef9-41a2-bf2e-f1fbac5e6529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:09.192951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9c5f5-3ef9-41a2-bf2e-f1fbac5e6529 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:09.215358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1050/2113] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:09.222014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc5f87-0bbb-41ec-bd06-a1b12a7791cd admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:09.238571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc5f87-0bbb-41ec-bd06-a1b12a7791cd admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:09.266728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:09.266728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:09.266728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:09.266728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] PATH_INFO: `/v3/projects/68880106efe94d4581c45d39d5dd5aae/users/78466818c44c4d5e9f8bf9673a381c8f/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:09.294618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68880106efe94d4581c45d39d5dd5aae, user_id=78466818c44c4d5e9f8bf9673a381c8f, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:09.297791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:09.392110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1064/2114] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:09 2022] PUT /identity/v3/projects/68880106efe94d4581c45d39d5dd5aae/users/78466818c44c4d5e9f8bf9673a381c8f/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:09.401072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be704a50-ec30-4d29-800d-36f0e670ced7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:09.401366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be704a50-ec30-4d29-800d-36f0e670ced7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:09.401650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be704a50-ec30-4d29-800d-36f0e670ced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:09.435265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-be704a50-ec30-4d29-800d-36f0e670ced7 None None] MFA Rules not processed for user `78466818c44c4d5e9f8bf9673a381c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:09.436500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-be704a50-ec30-4d29-800d-36f0e670ced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:09.510980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1051/2115] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:09.523291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:09.525100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:09.590922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a9b4f-31f1-4fb1-abd7-fe8277fc923f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:09.594650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb48828-5f9a-461a-8656-dead342c080a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:09.595832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48828-5f9a-461a-8656-dead342c080a service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:09.596152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48828-5f9a-461a-8656-dead342c080a service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:09.596459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48828-5f9a-461a-8656-dead342c080a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:09.611614 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb48828-5f9a-461a-8656-dead342c080a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:09.612116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb48828-5f9a-461a-8656-dead342c080a service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:09.631123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1065/2116] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:09.658918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be704a50-ec30-4d29-800d-36f0e670ced7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:09.751468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be704a50-ec30-4d29-800d-36f0e670ced7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:09.757062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:09.758777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:09.759162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:09.759737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] PATH_INFO: `/v3/users/78466818c44c4d5e9f8bf9673a381c8f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:09.761143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78466818c44c4d5e9f8bf9673a381c8f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:09.763432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:10.061824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78466818c44c4d5e9f8bf9673a381c8f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:10.062867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78466818c44c4d5e9f8bf9673a381c8f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:10.070795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78466818c44c4d5e9f8bf9673a381c8f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:10.070918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78466818c44c4d5e9f8bf9673a381c8f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:10.160328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78466818c44c4d5e9f8bf9673a381c8f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:10.181621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1052/2117] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:09 2022] DELETE /identity/v3/users/78466818c44c4d5e9f8bf9673a381c8f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:10.186951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78039b8a-cea2-4cda-9193-c6a435c34939 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:10.187508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78039b8a-cea2-4cda-9193-c6a435c34939 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:10.187908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78039b8a-cea2-4cda-9193-c6a435c34939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:10.209603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-78039b8a-cea2-4cda-9193-c6a435c34939 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:10.210939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-78039b8a-cea2-4cda-9193-c6a435c34939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:10.286933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1066/2118] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:10.293449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:10.295345 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:10.386288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fc7ae-d11e-449e-af66-e2835012c35c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:10.390260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c48ac-041a-43f9-a9db-7bc177d6de73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:10.391115 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c48ac-041a-43f9-a9db-7bc177d6de73 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:10.391472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c48ac-041a-43f9-a9db-7bc177d6de73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:10.391902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c48ac-041a-43f9-a9db-7bc177d6de73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:10.405399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c48ac-041a-43f9-a9db-7bc177d6de73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:10.410374 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c48ac-041a-43f9-a9db-7bc177d6de73 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:10.422816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1053/2119] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:11.076394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78039b8a-cea2-4cda-9193-c6a435c34939 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:11.078198 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-78039b8a-cea2-4cda-9193-c6a435c34939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:11.106189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78039b8a-cea2-4cda-9193-c6a435c34939 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:11.126273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:11.126273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:11.126273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:11.126273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] PATH_INFO: `/v3/projects/68880106efe94d4581c45d39d5dd5aae` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:11.128647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68880106efe94d4581c45d39d5dd5aae)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:11.131814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:11.247082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68880106efe94d4581c45d39d5dd5aae', 'request_id': 'req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:11.331254 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68880106efe94d4581c45d39d5dd5aae', 'request_id': 'req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:11.347072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68880106efe94d4581c45d39d5dd5aae', 'request_id': 'req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:11.371804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] The token cache is being invalidate because project 68880106efe94d4581c45d39d5dd5aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:11.372498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:11.373781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d58a65e6-6eec-495a-8b3b-f3acbceea2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:11.377666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1067/2120] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:11 2022] DELETE /identity/v3/projects/68880106efe94d4581c45d39d5dd5aae => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:11.385319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a69a-7bf4-4d53-ae4c-829a68525c9f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:11.386305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a69a-7bf4-4d53-ae4c-829a68525c9f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:11.386453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39a69a-7bf4-4d53-ae4c-829a68525c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:11.462353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-dc39a69a-7bf4-4d53-ae4c-829a68525c9f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:11.463639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-dc39a69a-7bf4-4d53-ae4c-829a68525c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:11.585448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1054/2121] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:11.587199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5f4d-f9c5-44e9-a4b8-6f6c3b59ea13 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:11.587503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5f4d-f9c5-44e9-a4b8-6f6c3b59ea13 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:11.588328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5f4d-f9c5-44e9-a4b8-6f6c3b59ea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:11.619364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-089f5f4d-f9c5-44e9-a4b8-6f6c3b59ea13 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:11.620920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-089f5f4d-f9c5-44e9-a4b8-6f6c3b59ea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:11.639818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1068/2122] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:11.643343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39a69a-7bf4-4d53-ae4c-829a68525c9f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:11.653472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39a69a-7bf4-4d53-ae4c-829a68525c9f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:11.660381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:11.661349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:11.662709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:11.662709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:11.663243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:11.663727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:11.665653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:11.683740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f5f4d-f9c5-44e9-a4b8-6f6c3b59ea13 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:11.689463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1055/2123] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:11.693514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f5f4d-f9c5-44e9-a4b8-6f6c3b59ea13 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:11.701599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804fb1-1a0d-48b3-ae11-b990ef366add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:11.703154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804fb1-1a0d-48b3-ae11-b990ef366add admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:11.703154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804fb1-1a0d-48b3-ae11-b990ef366add admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:11.703307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804fb1-1a0d-48b3-ae11-b990ef366add admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:11.704006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804fb1-1a0d-48b3-ae11-b990ef366add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:11.706907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804fb1-1a0d-48b3-ae11-b990ef366add admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:11.793903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:11.807921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1069/2124] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:11 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:40:11.817723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d21526-2ee4-4cd5-9240-237c73687efc admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:11.923089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b333c7-703f-4069-95dd-407b5a4a9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:11.924089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b333c7-703f-4069-95dd-407b5a4a9e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:11.924678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b333c7-703f-4069-95dd-407b5a4a9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:11.925328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b333c7-703f-4069-95dd-407b5a4a9e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:11.926039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b333c7-703f-4069-95dd-407b5a4a9e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:11.933058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b333c7-703f-4069-95dd-407b5a4a9e11 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:12.084860 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1056/2125] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:11 2022] POST /identity/v3/users => generated 287 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:12.086073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804fb1-1a0d-48b3-ae11-b990ef366add admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:12.099582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804fb1-1a0d-48b3-ae11-b990ef366add admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:12.105734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850ad9-cabf-41ad-8ff5-99eaffe7f00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:12.106467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850ad9-cabf-41ad-8ff5-99eaffe7f00a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:12.106798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850ad9-cabf-41ad-8ff5-99eaffe7f00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:12.107085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850ad9-cabf-41ad-8ff5-99eaffe7f00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:12.107975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32850ad9-cabf-41ad-8ff5-99eaffe7f00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:12.109725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32850ad9-cabf-41ad-8ff5-99eaffe7f00a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:12.123376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1070/2126] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:12.129518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b333c7-703f-4069-95dd-407b5a4a9e11 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:12.147048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b333c7-703f-4069-95dd-407b5a4a9e11 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:12.158721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec6970-60d8-4600-aefa-c553df812e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:12.158721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec6970-60d8-4600-aefa-c553df812e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:12.158721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec6970-60d8-4600-aefa-c553df812e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:12.158721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec6970-60d8-4600-aefa-c553df812e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:12.159152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec6970-60d8-4600-aefa-c553df812e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:12.159152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec6970-60d8-4600-aefa-c553df812e2c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:12.172218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1057/2127] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:12.176815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850ad9-cabf-41ad-8ff5-99eaffe7f00a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:12.190769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850ad9-cabf-41ad-8ff5-99eaffe7f00a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:12.217609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:12.221543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:12.221543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:12.221543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] PATH_INFO: `/v3/projects/002e55a552ac411ea3aa912031c2eced/users/93aaa10edc614d4c8185b66c3934d295/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:12.270772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=002e55a552ac411ea3aa912031c2eced, user_id=93aaa10edc614d4c8185b66c3934d295, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:12.278382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:12.382780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e99f6-8661-4279-9927-4d580bfc98f4 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:12.383737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e99f6-8661-4279-9927-4d580bfc98f4 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:12.384534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e99f6-8661-4279-9927-4d580bfc98f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:12.387090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1071/2128] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:12 2022] PUT /identity/v3/projects/002e55a552ac411ea3aa912031c2eced/users/93aaa10edc614d4c8185b66c3934d295/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:12.428884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-d44e99f6-8661-4279-9927-4d580bfc98f4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:12.430262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d44e99f6-8661-4279-9927-4d580bfc98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:12.577326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1058/2129] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:12.592626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:12.594937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:12.686609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef8d87-7393-433b-aa9f-c2bf92c5bd11 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:12.691177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9c07-7715-4fa8-87d2-6fd1ba350558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:12.692199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9c07-7715-4fa8-87d2-6fd1ba350558 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:12.692698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9c07-7715-4fa8-87d2-6fd1ba350558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:12.693207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9c07-7715-4fa8-87d2-6fd1ba350558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:12.704727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df9c07-7715-4fa8-87d2-6fd1ba350558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:12.710792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df9c07-7715-4fa8-87d2-6fd1ba350558 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:12.730430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1072/2130] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:13.337605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc313-9d04-42d9-9e53-549352ec0522 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:13.337802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc313-9d04-42d9-9e53-549352ec0522 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:13.338079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc313-9d04-42d9-9e53-549352ec0522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:13.364396 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-22bfc313-9d04-42d9-9e53-549352ec0522 None None] MFA Rules not processed for user `50998395da9a417eaa555e714c998496`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:13.365627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-22bfc313-9d04-42d9-9e53-549352ec0522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:13.476043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1059/2131] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:18.102727 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78d66-250f-4891-a4f7-0d50cf3ea557 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:18.108908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78d66-250f-4891-a4f7-0d50cf3ea557 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:18.108908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d78d66-250f-4891-a4f7-0d50cf3ea557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:18.154370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e5d78d66-250f-4891-a4f7-0d50cf3ea557 None None] MFA Rules not processed for user `82bcd0d11bc346858946b46d4b65c047`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:18.155890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e5d78d66-250f-4891-a4f7-0d50cf3ea557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:18.255493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1073/2132] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:18.260133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc313-9d04-42d9-9e53-549352ec0522 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:18.261710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-22bfc313-9d04-42d9-9e53-549352ec0522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:18.279924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc313-9d04-42d9-9e53-549352ec0522 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:18.286123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a6948-65ca-4af8-928e-451461d72708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:18.287041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a6948-65ca-4af8-928e-451461d72708 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:18.287475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a6948-65ca-4af8-928e-451461d72708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:18.288109 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a6948-65ca-4af8-928e-451461d72708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:18.288923 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a6948-65ca-4af8-928e-451461d72708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:18.291229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a6948-65ca-4af8-928e-451461d72708 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:18.410124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1060/2133] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:18 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:18.414709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d78d66-250f-4891-a4f7-0d50cf3ea557 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:18.476695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d78d66-250f-4891-a4f7-0d50cf3ea557 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:18.676222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5b01-032f-40d1-8c25-c9ff187b9d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:18.676939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5b01-032f-40d1-8c25-c9ff187b9d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:18.677225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5b01-032f-40d1-8c25-c9ff187b9d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:18.677532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf5b01-032f-40d1-8c25-c9ff187b9d8b admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:18.679165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5b01-032f-40d1-8c25-c9ff187b9d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:18.681360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf5b01-032f-40d1-8c25-c9ff187b9d8b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:18.823948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1074/2134] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:18 2022] POST /identity/v3/users => generated 298 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:18.828533 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a6948-65ca-4af8-928e-451461d72708 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:18.846455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a6948-65ca-4af8-928e-451461d72708 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:18.870878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16830319-9d0c-4e78-a3cb-69d401d0023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:18.871802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16830319-9d0c-4e78-a3cb-69d401d0023d admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:18.873262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16830319-9d0c-4e78-a3cb-69d401d0023d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:18.874586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16830319-9d0c-4e78-a3cb-69d401d0023d admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:18.875710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16830319-9d0c-4e78-a3cb-69d401d0023d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:18.884357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16830319-9d0c-4e78-a3cb-69d401d0023d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:18.913049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1061/2135] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:18.915126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5b01-032f-40d1-8c25-c9ff187b9d8b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:18.929841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf5b01-032f-40d1-8c25-c9ff187b9d8b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:18.942004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955442ef-cf13-4051-918c-0fbd87b97aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:18.948806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955442ef-cf13-4051-918c-0fbd87b97aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:18.949149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955442ef-cf13-4051-918c-0fbd87b97aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:18.949965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955442ef-cf13-4051-918c-0fbd87b97aa2 admin admin] PATH_INFO: `/v3/projects/792ca67aa4994535be22a71167ecd681/users/6832141a987446d8920935fc9c1603b5/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:18.974949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955442ef-cf13-4051-918c-0fbd87b97aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792ca67aa4994535be22a71167ecd681, user_id=6832141a987446d8920935fc9c1603b5, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:18.982427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955442ef-cf13-4051-918c-0fbd87b97aa2 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:19.050320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1075/2136] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:18 2022] PUT /identity/v3/projects/792ca67aa4994535be22a71167ecd681/users/6832141a987446d8920935fc9c1603b5/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:19.056070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16830319-9d0c-4e78-a3cb-69d401d0023d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:19.069753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16830319-9d0c-4e78-a3cb-69d401d0023d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:19.209395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:19.210215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:19.210686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:19.211068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:19.211960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:19.213936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:19.229117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1062/2137] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:19.233878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955442ef-cf13-4051-918c-0fbd87b97aa2 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:19.248148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955442ef-cf13-4051-918c-0fbd87b97aa2 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:19.254142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3257b-b335-4d49-86d4-2fa61b8a4ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:19.255455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3257b-b335-4d49-86d4-2fa61b8a4ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:19.256092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3257b-b335-4d49-86d4-2fa61b8a4ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:19.256536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3257b-b335-4d49-86d4-2fa61b8a4ae8 admin admin] PATH_INFO: `/v3/projects/792ca67aa4994535be22a71167ecd681/users/6832141a987446d8920935fc9c1603b5/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:19.259533 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3257b-b335-4d49-86d4-2fa61b8a4ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792ca67aa4994535be22a71167ecd681, user_id=6832141a987446d8920935fc9c1603b5, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:19.263056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3257b-b335-4d49-86d4-2fa61b8a4ae8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:19.315585 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1076/2138] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:19 2022] PUT /identity/v3/projects/792ca67aa4994535be22a71167ecd681/users/6832141a987446d8920935fc9c1603b5/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:19.488273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:19.491723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:19.516071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97980d61-b9e8-4b49-b17c-99e41c0079a2 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:19.666477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:19.667675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:19.668149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:19.668625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] PATH_INFO: `/v3/users/bce75690c0e140579184f626d757e289` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:19.670169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce75690c0e140579184f626d757e289)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:19.672545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:19.879216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce75690c0e140579184f626d757e289'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:19.879887 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce75690c0e140579184f626d757e289'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:19.898382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce75690c0e140579184f626d757e289'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:19.899315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce75690c0e140579184f626d757e289'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:19.965577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce75690c0e140579184f626d757e289'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:19.997443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1063/2139] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:19 2022] DELETE /identity/v3/users/bce75690c0e140579184f626d757e289 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:20.002550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c741-9259-4644-8037-c48d53923b80 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:20.003080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c741-9259-4644-8037-c48d53923b80 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:20.003442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c741-9259-4644-8037-c48d53923b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:20.025139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1766c741-9259-4644-8037-c48d53923b80 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:20.026702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1766c741-9259-4644-8037-c48d53923b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:20.139091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1077/2140] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:20.168527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:20.169843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:20.291488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6237d-fc61-4c51-8afa-d26a6353f70e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:20.301560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee348c00-f736-4f30-805c-323473c08aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:20.303766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee348c00-f736-4f30-805c-323473c08aae service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:20.304066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee348c00-f736-4f30-805c-323473c08aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:20.304350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee348c00-f736-4f30-805c-323473c08aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:20.327268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee348c00-f736-4f30-805c-323473c08aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:20.341606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee348c00-f736-4f30-805c-323473c08aae service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:20.359221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1064/2141] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:40:21.697358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766c741-9259-4644-8037-c48d53923b80 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:21.699028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1766c741-9259-4644-8037-c48d53923b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:21.722563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766c741-9259-4644-8037-c48d53923b80 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:21.740226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:21.745613 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:21.745613 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:21.746210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] PATH_INFO: `/v3/projects/ef96a08b651043cabbe5674e806a4227` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:21.747922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef96a08b651043cabbe5674e806a4227)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:21.750955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:21.934602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef96a08b651043cabbe5674e806a4227', 'request_id': 'req-c5878dd1-843f-4581-8553-e6e66715d742'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.001042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef96a08b651043cabbe5674e806a4227', 'request_id': 'req-c5878dd1-843f-4581-8553-e6e66715d742'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.011458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef96a08b651043cabbe5674e806a4227', 'request_id': 'req-c5878dd1-843f-4581-8553-e6e66715d742'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.069034 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] The token cache is being invalidate because project ef96a08b651043cabbe5674e806a4227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:22.069838 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.070820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c5878dd1-843f-4581-8553-e6e66715d742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.073876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1078/2142] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:21 2022] DELETE /identity/v3/projects/ef96a08b651043cabbe5674e806a4227 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:22.077610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee348c00-f736-4f30-805c-323473c08aae service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:22.089520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee348c00-f736-4f30-805c-323473c08aae service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:22.208869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:22.209791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:22.210083 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:22.210371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] PATH_INFO: `/v3/users/53ffb53bfc8c433b9b09e23ef36d6962` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:22.211749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ffb53bfc8c433b9b09e23ef36d6962)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:22.213724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:22.458172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ffb53bfc8c433b9b09e23ef36d6962'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.459064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ffb53bfc8c433b9b09e23ef36d6962'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.481763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ffb53bfc8c433b9b09e23ef36d6962'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.482572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ffb53bfc8c433b9b09e23ef36d6962'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.554434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ffb53bfc8c433b9b09e23ef36d6962'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:22.578853 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1065/2143] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:22 2022] DELETE /identity/v3/users/53ffb53bfc8c433b9b09e23ef36d6962 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:24.435785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e485e-9d4e-447f-b6cb-09b0c571f0e0 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:24.436650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e485e-9d4e-447f-b6cb-09b0c571f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:24.437074 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e485e-9d4e-447f-b6cb-09b0c571f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:24.494184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-586e485e-9d4e-447f-b6cb-09b0c571f0e0 None None] MFA Rules not processed for user `93aaa10edc614d4c8185b66c3934d295`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:24.495731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-586e485e-9d4e-447f-b6cb-09b0c571f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:24.555739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:24.557917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:24.637701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1079/2144] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:24.642691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e485e-9d4e-447f-b6cb-09b0c571f0e0 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:24.644268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-586e485e-9d4e-447f-b6cb-09b0c571f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:24.683911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8d0a-60fe-4a6b-94a2-1929902e93a0 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:24.694400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:24.694400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:24.694400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:24.694400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] PATH_INFO: `/v3/projects/a21c3ed7240a43d2b4c94393ba3b0f5a` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:24.694843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21c3ed7240a43d2b4c94393ba3b0f5a)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:24.696870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:24.742701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e485e-9d4e-447f-b6cb-09b0c571f0e0 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:24.768113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc1a45-f042-4dbe-af5a-e6b025de7c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:24.769558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc1a45-f042-4dbe-af5a-e6b025de7c35 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:24.769946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc1a45-f042-4dbe-af5a-e6b025de7c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:24.770373 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc1a45-f042-4dbe-af5a-e6b025de7c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:24.771247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc1a45-f042-4dbe-af5a-e6b025de7c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:24.773389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc1a45-f042-4dbe-af5a-e6b025de7c35 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:24.860386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21c3ed7240a43d2b4c94393ba3b0f5a', 'request_id': 'req-317d1328-666a-4d7c-aacb-e89b53294ed5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:24.901716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1080/2145] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:24 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:24.908040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc1a45-f042-4dbe-af5a-e6b025de7c35 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:24.938110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21c3ed7240a43d2b4c94393ba3b0f5a', 'request_id': 'req-317d1328-666a-4d7c-aacb-e89b53294ed5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:24.946346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21c3ed7240a43d2b4c94393ba3b0f5a', 'request_id': 'req-317d1328-666a-4d7c-aacb-e89b53294ed5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:24.994401 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] The token cache is being invalidate because project a21c3ed7240a43d2b4c94393ba3b0f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:25.003086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:25.017436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-317d1328-666a-4d7c-aacb-e89b53294ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:25.018094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1066/2146] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:24 2022] DELETE /identity/v3/projects/a21c3ed7240a43d2b4c94393ba3b0f5a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:25.022645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13c7a0-a5d0-4f4f-812d-6eef85d91a67 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.023143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13c7a0-a5d0-4f4f-812d-6eef85d91a67 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.023581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13c7a0-a5d0-4f4f-812d-6eef85d91a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.079097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc1a45-f042-4dbe-af5a-e6b025de7c35 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.088150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.088870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.089743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.090457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.090958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.093290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.097736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-bd13c7a0-a5d0-4f4f-812d-6eef85d91a67 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:25.101510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bd13c7a0-a5d0-4f4f-812d-6eef85d91a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:25.143168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1067/2147] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:25.152283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac676cd-aa91-40d5-90a8-d5753b2991d5 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.153531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac676cd-aa91-40d5-90a8-d5753b2991d5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.153966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac676cd-aa91-40d5-90a8-d5753b2991d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.181677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-fac676cd-aa91-40d5-90a8-d5753b2991d5 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:25.183299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fac676cd-aa91-40d5-90a8-d5753b2991d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:25.195262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1068/2148] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:25.199438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac676cd-aa91-40d5-90a8-d5753b2991d5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.205029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1081/2149] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:24 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:25.213820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.217911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:25.236658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13370-e0a4-44c4-a48a-011f9c034ea0 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.239578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac676cd-aa91-40d5-90a8-d5753b2991d5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.242834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4819f-5751-4193-9381-12d42283c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.243523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4819f-5751-4193-9381-12d42283c568 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.243814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4819f-5751-4193-9381-12d42283c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.244102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4819f-5751-4193-9381-12d42283c568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.246422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4819f-5751-4193-9381-12d42283c568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.247505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4819f-5751-4193-9381-12d42283c568 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.252070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.253021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.254704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.255214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.257184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:25.258378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.260470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1082/2150] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:25.262604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.268588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4819f-5751-4193-9381-12d42283c568 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.293775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1069/2151] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:25.299101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.312962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4819f-5751-4193-9381-12d42283c568 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.317654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584e41-3b60-4df0-aa83-3e2ad7d802a0 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.324301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938378a3-3f02-4d59-bb86-3e5ebafd0a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.325241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938378a3-3f02-4d59-bb86-3e5ebafd0a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.325523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938378a3-3f02-4d59-bb86-3e5ebafd0a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.325798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938378a3-3f02-4d59-bb86-3e5ebafd0a2e admin admin] PATH_INFO: `/v3/projects/400b3bf1b5024f47844ec7e895cbc5d9/users/335bd425c08b449d899cc6f5627eeb10/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.332706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b324c-bc90-4528-bde9-ab8e2f1249bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.337660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b324c-bc90-4528-bde9-ab8e2f1249bd admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.338025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b324c-bc90-4528-bde9-ab8e2f1249bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.338314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b324c-bc90-4528-bde9-ab8e2f1249bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.343190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b324c-bc90-4528-bde9-ab8e2f1249bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.351749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b324c-bc90-4528-bde9-ab8e2f1249bd admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.351943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938378a3-3f02-4d59-bb86-3e5ebafd0a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=400b3bf1b5024f47844ec7e895cbc5d9, user_id=335bd425c08b449d899cc6f5627eeb10, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.355349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938378a3-3f02-4d59-bb86-3e5ebafd0a2e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.438087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1083/2152] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:25 2022] PUT /identity/v3/projects/400b3bf1b5024f47844ec7e895cbc5d9/users/335bd425c08b449d899cc6f5627eeb10/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:25.439633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938378a3-3f02-4d59-bb86-3e5ebafd0a2e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.470506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1070/2153] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:25 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:40:25.474371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b324c-bc90-4528-bde9-ab8e2f1249bd admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.591429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938378a3-3f02-4d59-bb86-3e5ebafd0a2e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.637800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b324c-bc90-4528-bde9-ab8e2f1249bd admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.647599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c97b-d2a0-453d-826e-397641b0630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.648662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c97b-d2a0-453d-826e-397641b0630b admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.649502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c97b-d2a0-453d-826e-397641b0630b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.649972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c97b-d2a0-453d-826e-397641b0630b admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.650973 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3c97b-d2a0-453d-826e-397641b0630b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.655517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3c97b-d2a0-453d-826e-397641b0630b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.747190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375023b-55bd-491b-a5b3-d5eb52a32cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.758256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1071/2154] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:25 2022] POST /identity/v3/users => generated 284 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:25.759846 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375023b-55bd-491b-a5b3-d5eb52a32cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.760512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375023b-55bd-491b-a5b3-d5eb52a32cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.762468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c97b-d2a0-453d-826e-397641b0630b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.767285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375023b-55bd-491b-a5b3-d5eb52a32cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.768192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375023b-55bd-491b-a5b3-d5eb52a32cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.778709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375023b-55bd-491b-a5b3-d5eb52a32cdc admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.798570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c97b-d2a0-453d-826e-397641b0630b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.815215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1084/2155] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:25.815764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a7723-3faf-4b48-8243-86886761da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.816460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7723-3faf-4b48-8243-86886761da31 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.816750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7723-3faf-4b48-8243-86886761da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.817033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7723-3faf-4b48-8243-86886761da31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.821107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375023b-55bd-491b-a5b3-d5eb52a32cdc admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.824863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a7723-3faf-4b48-8243-86886761da31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.831619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a7723-3faf-4b48-8243-86886761da31 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.865201 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375023b-55bd-491b-a5b3-d5eb52a32cdc admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.878728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1072/2156] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:25.882035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120f2c1-33c5-4e92-bc37-16aa61010d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.884572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a7723-3faf-4b48-8243-86886761da31 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:25.886730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120f2c1-33c5-4e92-bc37-16aa61010d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.887007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120f2c1-33c5-4e92-bc37-16aa61010d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.887280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120f2c1-33c5-4e92-bc37-16aa61010d39 admin admin] PATH_INFO: `/v3/projects/400b3bf1b5024f47844ec7e895cbc5d9/users/335bd425c08b449d899cc6f5627eeb10/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.898282 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120f2c1-33c5-4e92-bc37-16aa61010d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400b3bf1b5024f47844ec7e895cbc5d9, user_id=335bd425c08b449d899cc6f5627eeb10, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.907992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120f2c1-33c5-4e92-bc37-16aa61010d39 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.916575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a7723-3faf-4b48-8243-86886761da31 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:25.939242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992b2a-b5aa-45e6-94b0-0bc93ce98e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:25.944695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992b2a-b5aa-45e6-94b0-0bc93ce98e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:25.944998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992b2a-b5aa-45e6-94b0-0bc93ce98e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:25.950411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992b2a-b5aa-45e6-94b0-0bc93ce98e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:25.951710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25992b2a-b5aa-45e6-94b0-0bc93ce98e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:25.954296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1085/2157] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:25 2022] PUT /identity/v3/projects/400b3bf1b5024f47844ec7e895cbc5d9/users/335bd425c08b449d899cc6f5627eeb10/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:25.957220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25992b2a-b5aa-45e6-94b0-0bc93ce98e02 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:25.986578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1073/2158] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:25.990754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120f2c1-33c5-4e92-bc37-16aa61010d39 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:26.188463 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120f2c1-33c5-4e92-bc37-16aa61010d39 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:26.193698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191fb04-f843-4bd5-9b37-bbb2a1f7daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:26.194651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191fb04-f843-4bd5-9b37-bbb2a1f7daf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:26.194943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191fb04-f843-4bd5-9b37-bbb2a1f7daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:26.195227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191fb04-f843-4bd5-9b37-bbb2a1f7daf6 admin admin] PATH_INFO: `/v3/projects/1c34652a8db84b79ab211c01165a0d6d/users/0764ef2039eb43cb84e45bcaedb0e1ef/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:26.225890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191fb04-f843-4bd5-9b37-bbb2a1f7daf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c34652a8db84b79ab211c01165a0d6d, user_id=0764ef2039eb43cb84e45bcaedb0e1ef, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:26.233336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191fb04-f843-4bd5-9b37-bbb2a1f7daf6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:26.327586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1086/2159] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:25 2022] PUT /identity/v3/projects/1c34652a8db84b79ab211c01165a0d6d/users/0764ef2039eb43cb84e45bcaedb0e1ef/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:26.340389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6b61d-e87b-4b8a-9237-69ef7f39ff68 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:26.340486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6b61d-e87b-4b8a-9237-69ef7f39ff68 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:26.340780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6b61d-e87b-4b8a-9237-69ef7f39ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:26.395590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-8bb6b61d-e87b-4b8a-9237-69ef7f39ff68 None None] MFA Rules not processed for user `0764ef2039eb43cb84e45bcaedb0e1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:26.400308 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8bb6b61d-e87b-4b8a-9237-69ef7f39ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:26.548289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1074/2160] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:26.553338 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191fb04-f843-4bd5-9b37-bbb2a1f7daf6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:26.661963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191fb04-f843-4bd5-9b37-bbb2a1f7daf6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:26.668916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a3ed9-db8a-416b-ab17-d592234f6d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:26.670289 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a3ed9-db8a-416b-ab17-d592234f6d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:26.670909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a3ed9-db8a-416b-ab17-d592234f6d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:26.671355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a3ed9-db8a-416b-ab17-d592234f6d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:26.672208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a3ed9-db8a-416b-ab17-d592234f6d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:26.674498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a3ed9-db8a-416b-ab17-d592234f6d73 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:26.800265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1087/2161] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:26 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:26.804119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6b61d-e87b-4b8a-9237-69ef7f39ff68 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:26.824883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6b61d-e87b-4b8a-9237-69ef7f39ff68 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:26.979246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18d235-bed8-48a8-9134-2c81994306f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:26.979940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d235-bed8-48a8-9134-2c81994306f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:26.980228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d235-bed8-48a8-9134-2c81994306f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:26.980527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d235-bed8-48a8-9134-2c81994306f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:26.981654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18d235-bed8-48a8-9134-2c81994306f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:26.990869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18d235-bed8-48a8-9134-2c81994306f3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:27.175891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a3ed9-db8a-416b-ab17-d592234f6d73 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:27.182273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1075/2162] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:26 2022] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:27.187715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a3ed9-db8a-416b-ab17-d592234f6d73 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:27.193225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9f7b4-3c23-486d-8f9e-d3631058fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:27.194102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f7b4-3c23-486d-8f9e-d3631058fed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:27.194558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f7b4-3c23-486d-8f9e-d3631058fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:27.194979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f7b4-3c23-486d-8f9e-d3631058fed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:27.195861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9f7b4-3c23-486d-8f9e-d3631058fed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:27.197738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9f7b4-3c23-486d-8f9e-d3631058fed4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:27.218304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1088/2163] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:27.219556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18d235-bed8-48a8-9134-2c81994306f3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:27.231432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18d235-bed8-48a8-9134-2c81994306f3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:27.248707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda7e8-af39-4a61-81c6-027ec9b70d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:27.249978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda7e8-af39-4a61-81c6-027ec9b70d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:27.250644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda7e8-af39-4a61-81c6-027ec9b70d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:27.251121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda7e8-af39-4a61-81c6-027ec9b70d42 admin admin] PATH_INFO: `/v3/projects/b9b7d04aee6946b0a56b85e0714b43aa/users/c2f1b01ead584d4d936f88623578cd4b/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:27.297505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacda7e8-af39-4a61-81c6-027ec9b70d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b7d04aee6946b0a56b85e0714b43aa, user_id=c2f1b01ead584d4d936f88623578cd4b, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:27.305624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacda7e8-af39-4a61-81c6-027ec9b70d42 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:27.429132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1076/2164] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:27 2022] PUT /identity/v3/projects/b9b7d04aee6946b0a56b85e0714b43aa/users/c2f1b01ead584d4d936f88623578cd4b/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:27.430692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9f7b4-3c23-486d-8f9e-d3631058fed4 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:27.447028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9f7b4-3c23-486d-8f9e-d3631058fed4 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:27.633294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ff145-0c0c-4901-a8d2-b92090a9ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:27.634014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff145-0c0c-4901-a8d2-b92090a9ead5 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:27.634324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff145-0c0c-4901-a8d2-b92090a9ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:27.634656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff145-0c0c-4901-a8d2-b92090a9ead5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:27.635619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ff145-0c0c-4901-a8d2-b92090a9ead5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:27.659612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ff145-0c0c-4901-a8d2-b92090a9ead5 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:27.682108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1089/2165] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:27.686426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda7e8-af39-4a61-81c6-027ec9b70d42 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:27.700046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda7e8-af39-4a61-81c6-027ec9b70d42 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:27.712380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:27.713609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:27.714116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:27.714493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] PATH_INFO: `/v3/projects/b9b7d04aee6946b0a56b85e0714b43aa/users/c2f1b01ead584d4d936f88623578cd4b/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:27.716665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b7d04aee6946b0a56b85e0714b43aa, user_id=c2f1b01ead584d4d936f88623578cd4b, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:27.720275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:27.738714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1077/2166] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:27 2022] PUT /identity/v3/projects/b9b7d04aee6946b0a56b85e0714b43aa/users/c2f1b01ead584d4d936f88623578cd4b/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:27.748913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f177-98d6-4a9c-8fbb-9fd5bab85fa2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:27.749214 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f177-98d6-4a9c-8fbb-9fd5bab85fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:27.749488 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06f177-98d6-4a9c-8fbb-9fd5bab85fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:27.797296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-3b06f177-98d6-4a9c-8fbb-9fd5bab85fa2 None None] MFA Rules not processed for user `c2f1b01ead584d4d936f88623578cd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:27.798710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3b06f177-98d6-4a9c-8fbb-9fd5bab85fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:27.983789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1090/2167] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:27.995775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:27.998368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:28.083531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d5bc-daf2-424d-ba02-8dc6c3f1c3d3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:28.089546 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:28.090223 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:28.104131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:28.104131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:28.133073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:28.136179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:28.169131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1078/2168] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:29.196331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61131f3-3dcd-4a0c-ad3b-8153a2a8c5ee None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:29.196798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61131f3-3dcd-4a0c-ad3b-8153a2a8c5ee None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:29.196890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61131f3-3dcd-4a0c-ad3b-8153a2a8c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:29.232587 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a61131f3-3dcd-4a0c-ad3b-8153a2a8c5ee None None] MFA Rules not processed for user `6832141a987446d8920935fc9c1603b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:29.233878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a61131f3-3dcd-4a0c-ad3b-8153a2a8c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:29.364801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1091/2169] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:29.384237 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:29.386130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:29.531785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493833-8830-45d7-94bf-8986f02bc9df service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:29.547584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f2a360a89548208edd5fdff1a04e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:29.547584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:29.547584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:29.547584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:29.553255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:29.642445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:29.644549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:29.683197 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1079/2170] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:30.103943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a897-0756-42f0-9e87-6a599e33b941 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:30.104411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a897-0756-42f0-9e87-6a599e33b941 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:30.104907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a897-0756-42f0-9e87-6a599e33b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:30.153395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8539a897-0756-42f0-9e87-6a599e33b941 None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:30.155440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8539a897-0756-42f0-9e87-6a599e33b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:30.264723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1092/2171] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:40:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:30.361505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:30.363650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:30.534651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aba3-05fd-48db-b5c3-cba196091e19 service glance] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:30.540942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446f0e1-2010-4107-a69c-733f448893c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:30.541516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f0e1-2010-4107-a69c-733f448893c0 service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:30.541798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f0e1-2010-4107-a69c-733f448893c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:30.542078 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f0e1-2010-4107-a69c-733f448893c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:30.556452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446f0e1-2010-4107-a69c-733f448893c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:30.556883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446f0e1-2010-4107-a69c-733f448893c0 service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:30.581597 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1080/2172] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:40:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:40:33.223008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a897-0756-42f0-9e87-6a599e33b941 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:33.414448 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a897-0756-42f0-9e87-6a599e33b941 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:33.432027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:33.433386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:33.433883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:33.434320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] PATH_INFO: `/v3/users/0764ef2039eb43cb84e45bcaedb0e1ef` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:33.438223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0764ef2039eb43cb84e45bcaedb0e1ef)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:33.446810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:33.739057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0764ef2039eb43cb84e45bcaedb0e1ef'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:33.757790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0764ef2039eb43cb84e45bcaedb0e1ef'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:33.758597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0764ef2039eb43cb84e45bcaedb0e1ef'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:33.761102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0764ef2039eb43cb84e45bcaedb0e1ef'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:33.850403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0764ef2039eb43cb84e45bcaedb0e1ef'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:33.887043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1093/2173] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:33 2022] DELETE /identity/v3/users/0764ef2039eb43cb84e45bcaedb0e1ef => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:33.892222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f5945-e224-4fc5-8ddd-64a492b38f05 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:33.893242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f5945-e224-4fc5-8ddd-64a492b38f05 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:33.893675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f5945-e224-4fc5-8ddd-64a492b38f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:33.932624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-947f5945-e224-4fc5-8ddd-64a492b38f05 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:33.935344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-947f5945-e224-4fc5-8ddd-64a492b38f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:34.066835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1081/2174] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:34.077004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:34.079155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:34.292841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ca12e-d443-4ce4-8adc-c60faeb7fafe admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:34.304635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f6b1d-bec4-43f7-8e8c-90cd9e27c3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:34.306612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6b1d-bec4-43f7-8e8c-90cd9e27c3be service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:34.307725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6b1d-bec4-43f7-8e8c-90cd9e27c3be service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:34.309221 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f6b1d-bec4-43f7-8e8c-90cd9e27c3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:34.330763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f6b1d-bec4-43f7-8e8c-90cd9e27c3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:34.332789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f6b1d-bec4-43f7-8e8c-90cd9e27c3be service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:34.347499 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1094/2175] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:35.505684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f5945-e224-4fc5-8ddd-64a492b38f05 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:35.511286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-947f5945-e224-4fc5-8ddd-64a492b38f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:35.531001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f5945-e224-4fc5-8ddd-64a492b38f05 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:35.550173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:35.551414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:35.552568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:35.553169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] PATH_INFO: `/v3/projects/1c34652a8db84b79ab211c01165a0d6d` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:35.559727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c34652a8db84b79ab211c01165a0d6d)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:35.562052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:35.765168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c34652a8db84b79ab211c01165a0d6d', 'request_id': 'req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:35.839123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c34652a8db84b79ab211c01165a0d6d', 'request_id': 'req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:35.847553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c34652a8db84b79ab211c01165a0d6d', 'request_id': 'req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:35.864739 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] The token cache is being invalidate because project 1c34652a8db84b79ab211c01165a0d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:35.865109 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:35.866338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-30d811c6-3f0a-44e0-b1e7-fb78fb9648fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:35.869201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1082/2176] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:35 2022] DELETE /identity/v3/projects/1c34652a8db84b79ab211c01165a0d6d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:35.872871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f6b1d-bec4-43f7-8e8c-90cd9e27c3be service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:35.888315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f6b1d-bec4-43f7-8e8c-90cd9e27c3be service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:36.034093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:36.039174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:36.039174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:36.039174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] PATH_INFO: `/v3/users/c2f1b01ead584d4d936f88623578cd4b` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:36.039174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2f1b01ead584d4d936f88623578cd4b)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:36.042716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:36.396379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2f1b01ead584d4d936f88623578cd4b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:36.412626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2f1b01ead584d4d936f88623578cd4b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:36.413712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2f1b01ead584d4d936f88623578cd4b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:36.427169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2f1b01ead584d4d936f88623578cd4b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:36.502190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2f1b01ead584d4d936f88623578cd4b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:36.543749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1095/2177] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:35 2022] DELETE /identity/v3/users/c2f1b01ead584d4d936f88623578cd4b => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:40:37.978400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea37166-b5e4-4096-9102-bcbe93ae68f5 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:37.980395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea37166-b5e4-4096-9102-bcbe93ae68f5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:37.981075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea37166-b5e4-4096-9102-bcbe93ae68f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:38.052717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-0ea37166-b5e4-4096-9102-bcbe93ae68f5 None None] MFA Rules not processed for user `335bd425c08b449d899cc6f5627eeb10`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:38.055271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0ea37166-b5e4-4096-9102-bcbe93ae68f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:38.228518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1083/2178] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:38.240638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:38.246225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:38.415840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea37166-b5e4-4096-9102-bcbe93ae68f5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:38.417112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0ea37166-b5e4-4096-9102-bcbe93ae68f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:38.589429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03174-78e3-4188-b1bb-65d00de58cea admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:38.601609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e56176-a50b-4a7e-ad1b-39eb7f5da022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:38.602288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56176-a50b-4a7e-ad1b-39eb7f5da022 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:38.602629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56176-a50b-4a7e-ad1b-39eb7f5da022 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:38.602881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56176-a50b-4a7e-ad1b-39eb7f5da022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:38.603520 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea37166-b5e4-4096-9102-bcbe93ae68f5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:38.605059 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c5e56176-a50b-4a7e-ad1b-39eb7f5da022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:38.608707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:38.609582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:38.609914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:38.610198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] PATH_INFO: `/v3/projects/b9b7d04aee6946b0a56b85e0714b43aa` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:38.611990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b7d04aee6946b0a56b85e0714b43aa)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:38.614127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:38.699237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e56176-a50b-4a7e-ad1b-39eb7f5da022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:38.701371 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e56176-a50b-4a7e-ad1b-39eb7f5da022 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:38.752634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1096/2179] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:39.079536 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b7d04aee6946b0a56b85e0714b43aa', 'request_id': 'req-c0085da0-16f1-42e7-a5a2-f415b96b3ace'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:39.142714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b7d04aee6946b0a56b85e0714b43aa', 'request_id': 'req-c0085da0-16f1-42e7-a5a2-f415b96b3ace'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:39.153875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b7d04aee6946b0a56b85e0714b43aa', 'request_id': 'req-c0085da0-16f1-42e7-a5a2-f415b96b3ace'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:39.180708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] The token cache is being invalidate because project b9b7d04aee6946b0a56b85e0714b43aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:39.183720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:39.186782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c0085da0-16f1-42e7-a5a2-f415b96b3ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:39.191361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1084/2180] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:38 2022] DELETE /identity/v3/projects/b9b7d04aee6946b0a56b85e0714b43aa => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:39.196040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada250-a848-470e-bf83-8f4020421c80 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:39.196338 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada250-a848-470e-bf83-8f4020421c80 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:39.196625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada250-a848-470e-bf83-8f4020421c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:39.258555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-fcada250-a848-470e-bf83-8f4020421c80 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:39.259861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fcada250-a848-470e-bf83-8f4020421c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:39.356972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1097/2181] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:39.364456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af8a0f-ab74-42ce-a345-2669698b8a6a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:39.366713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af8a0f-ab74-42ce-a345-2669698b8a6a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:39.367171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af8a0f-ab74-42ce-a345-2669698b8a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:39.396576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-09af8a0f-ab74-42ce-a345-2669698b8a6a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:39.397731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-09af8a0f-ab74-42ce-a345-2669698b8a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:39.414905 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1085/2182] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:39.419174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcada250-a848-470e-bf83-8f4020421c80 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:39.431284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcada250-a848-470e-bf83-8f4020421c80 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:39.436984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:39.447214 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:39.454848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:39.455406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:39.456317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:39.456735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:39.458485 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:39.511666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1098/2183] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:39.513711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af8a0f-ab74-42ce-a345-2669698b8a6a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:39.533812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af8a0f-ab74-42ce-a345-2669698b8a6a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:39.543402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252956f-9802-40ed-b0ef-719c505d28a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:39.544192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252956f-9802-40ed-b0ef-719c505d28a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:39.544548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252956f-9802-40ed-b0ef-719c505d28a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:39.544890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252956f-9802-40ed-b0ef-719c505d28a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:39.545731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252956f-9802-40ed-b0ef-719c505d28a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:39.547893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252956f-9802-40ed-b0ef-719c505d28a4 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:39.664619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1086/2184] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:39 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:39.668583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:39.684452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7809bb-0e6a-46fe-8771-02f2d76dafb9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:39.856143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d734df-11e3-4ae4-8bb6-d16fe0287312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:39.856962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d734df-11e3-4ae4-8bb6-d16fe0287312 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:39.859267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d734df-11e3-4ae4-8bb6-d16fe0287312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:39.859625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d734df-11e3-4ae4-8bb6-d16fe0287312 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:39.861601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d734df-11e3-4ae4-8bb6-d16fe0287312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:39.867738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d734df-11e3-4ae4-8bb6-d16fe0287312 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:39.959701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1099/2185] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:39 2022] POST /identity/v3/users => generated 295 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:39.963205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252956f-9802-40ed-b0ef-719c505d28a4 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:39.978505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252956f-9802-40ed-b0ef-719c505d28a4 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:39.988543 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10bf3-5167-4700-b5fa-4d16570e08b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:39.989378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10bf3-5167-4700-b5fa-4d16570e08b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:39.991547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10bf3-5167-4700-b5fa-4d16570e08b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:39.991547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10bf3-5167-4700-b5fa-4d16570e08b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:39.991547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d10bf3-5167-4700-b5fa-4d16570e08b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:39.992405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d10bf3-5167-4700-b5fa-4d16570e08b2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:40.004803 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1087/2186] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:40.008459 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d734df-11e3-4ae4-8bb6-d16fe0287312 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:40.022275 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d734df-11e3-4ae4-8bb6-d16fe0287312 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:40.028589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a80b2b-0dd1-48e2-a346-b5bf425ce755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:40.031977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80b2b-0dd1-48e2-a346-b5bf425ce755 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:40.031977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80b2b-0dd1-48e2-a346-b5bf425ce755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:40.031977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80b2b-0dd1-48e2-a346-b5bf425ce755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:40.031977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a80b2b-0dd1-48e2-a346-b5bf425ce755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:40.032818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a80b2b-0dd1-48e2-a346-b5bf425ce755 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:40.064634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1100/2187] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:40.079046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10bf3-5167-4700-b5fa-4d16570e08b2 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:40.089556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10bf3-5167-4700-b5fa-4d16570e08b2 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:40.095552 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087b622-ab46-4ff7-84cb-8ebc15c7d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:40.096717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087b622-ab46-4ff7-84cb-8ebc15c7d2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:40.097174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087b622-ab46-4ff7-84cb-8ebc15c7d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:40.097603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087b622-ab46-4ff7-84cb-8ebc15c7d2c1 admin admin] PATH_INFO: `/v3/projects/ee336f8313fc4c039a8ce25bbbd9d9e8/users/927bae2d8e164509acc35650259cd874/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:40.123751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087b622-ab46-4ff7-84cb-8ebc15c7d2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee336f8313fc4c039a8ce25bbbd9d9e8, user_id=927bae2d8e164509acc35650259cd874, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:40.129941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087b622-ab46-4ff7-84cb-8ebc15c7d2c1 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:40.254572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861ec6e-f678-4805-b15e-742f07a8948e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:40.255210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861ec6e-f678-4805-b15e-742f07a8948e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:40.255950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861ec6e-f678-4805-b15e-742f07a8948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:40.258201 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1088/2188] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:40 2022] PUT /identity/v3/projects/ee336f8313fc4c039a8ce25bbbd9d9e8/users/927bae2d8e164509acc35650259cd874/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:40.314043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-0861ec6e-f678-4805-b15e-742f07a8948e None None] MFA Rules not processed for user `927bae2d8e164509acc35650259cd874`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:40.316006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0861ec6e-f678-4805-b15e-742f07a8948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:40.432176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1101/2189] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:40.436814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087b622-ab46-4ff7-84cb-8ebc15c7d2c1 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:40.568468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087b622-ab46-4ff7-84cb-8ebc15c7d2c1 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:40.589294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe45ec-4381-431c-a17f-8b84d751c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:40.591109 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe45ec-4381-431c-a17f-8b84d751c880 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:40.591109 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe45ec-4381-431c-a17f-8b84d751c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:40.591109 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe45ec-4381-431c-a17f-8b84d751c880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:40.591811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe45ec-4381-431c-a17f-8b84d751c880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:40.594095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe45ec-4381-431c-a17f-8b84d751c880 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:40.737151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1089/2190] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:40 2022] POST /identity/v3/projects => generated 393 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:40.742705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861ec6e-f678-4805-b15e-742f07a8948e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:40.759322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861ec6e-f678-4805-b15e-742f07a8948e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:40.909096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23db2-42cb-463b-b9ea-15cf296a1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:40.909792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23db2-42cb-463b-b9ea-15cf296a1b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:40.910079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23db2-42cb-463b-b9ea-15cf296a1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:40.910384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff23db2-42cb-463b-b9ea-15cf296a1b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:40.911123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff23db2-42cb-463b-b9ea-15cf296a1b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:40.913273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff23db2-42cb-463b-b9ea-15cf296a1b4d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:41.035520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1102/2191] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:40 2022] POST /identity/v3/users => generated 303 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:41.039611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe45ec-4381-431c-a17f-8b84d751c880 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:41.056721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe45ec-4381-431c-a17f-8b84d751c880 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:41.070486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a60b1-a5de-4e21-bdfc-731c2d3f4c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:41.071379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a60b1-a5de-4e21-bdfc-731c2d3f4c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:41.071840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a60b1-a5de-4e21-bdfc-731c2d3f4c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:41.072263 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a60b1-a5de-4e21-bdfc-731c2d3f4c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:41.073145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a60b1-a5de-4e21-bdfc-731c2d3f4c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:41.075393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a60b1-a5de-4e21-bdfc-731c2d3f4c91 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:41.107283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1090/2192] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:41.111558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23db2-42cb-463b-b9ea-15cf296a1b4d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:41.125461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff23db2-42cb-463b-b9ea-15cf296a1b4d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:41.140712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a8739-08b5-4513-a0c5-41d3eb84a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:41.142978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a8739-08b5-4513-a0c5-41d3eb84a86d admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:41.143464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a8739-08b5-4513-a0c5-41d3eb84a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:41.143914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a8739-08b5-4513-a0c5-41d3eb84a86d admin admin] PATH_INFO: `/v3/projects/4e8fe579289743788fcacb9bcc7ffed7/users/1e7a8cef46dc40478a368bc41a82d9b9/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:41.175580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a8739-08b5-4513-a0c5-41d3eb84a86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8fe579289743788fcacb9bcc7ffed7, user_id=1e7a8cef46dc40478a368bc41a82d9b9, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:41.178708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a8739-08b5-4513-a0c5-41d3eb84a86d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:41.297520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1103/2193] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:41 2022] PUT /identity/v3/projects/4e8fe579289743788fcacb9bcc7ffed7/users/1e7a8cef46dc40478a368bc41a82d9b9/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:41.301647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a60b1-a5de-4e21-bdfc-731c2d3f4c91 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:41.317501 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a60b1-a5de-4e21-bdfc-731c2d3f4c91 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:41.431766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9662c5-2c8d-45b3-8fcf-131d40ce32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:41.432901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9662c5-2c8d-45b3-8fcf-131d40ce32be admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:41.433375 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9662c5-2c8d-45b3-8fcf-131d40ce32be admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:41.434899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9662c5-2c8d-45b3-8fcf-131d40ce32be admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:41.435935 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9662c5-2c8d-45b3-8fcf-131d40ce32be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:41.437778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9662c5-2c8d-45b3-8fcf-131d40ce32be admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:41.451639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1091/2194] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:41.455392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a8739-08b5-4513-a0c5-41d3eb84a86d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:41.482656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a8739-08b5-4513-a0c5-41d3eb84a86d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:41.521248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:41.522480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:41.522939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:41.523368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] PATH_INFO: `/v3/projects/4e8fe579289743788fcacb9bcc7ffed7/users/1e7a8cef46dc40478a368bc41a82d9b9/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:41.531795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8fe579289743788fcacb9bcc7ffed7, user_id=1e7a8cef46dc40478a368bc41a82d9b9, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:41.535519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:41.569368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1104/2195] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:41 2022] PUT /identity/v3/projects/4e8fe579289743788fcacb9bcc7ffed7/users/1e7a8cef46dc40478a368bc41a82d9b9/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:41.571607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f3f02-a054-41c5-9bf0-97d1a0c865a5 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:41.575545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f3f02-a054-41c5-9bf0-97d1a0c865a5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:41.575545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f3f02-a054-41c5-9bf0-97d1a0c865a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:41.624138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7c6f3f02-a054-41c5-9bf0-97d1a0c865a5 None None] MFA Rules not processed for user `1e7a8cef46dc40478a368bc41a82d9b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:41.625410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7c6f3f02-a054-41c5-9bf0-97d1a0c865a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:41.760123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1092/2196] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:41.789204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:41.792796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:41.798379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f3f02-a054-41c5-9bf0-97d1a0c865a5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:41.800712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7c6f3f02-a054-41c5-9bf0-97d1a0c865a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:41.942247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f3f02-a054-41c5-9bf0-97d1a0c865a5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:41.952509 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21155b4-ca6e-42a0-a05e-7828fe1da599 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:41.953331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:41.955497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:41.955866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:41.957498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:41.959024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:41.960148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:41.960593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:41.961028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] PATH_INFO: `/v3/users/376982e96dd94a929bf1c14f63876960` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:41.962419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376982e96dd94a929bf1c14f63876960)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:41.965409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:42.007936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:42.010690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:42.040265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1093/2197] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:40:42.135851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:42.137678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:42.159596 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76971f-5bac-4256-9b1e-49de19587e8c service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:42.166278 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd684ad-46d9-4014-862f-247cdd601ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:42.167329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd684ad-46d9-4014-862f-247cdd601ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:42.167851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd684ad-46d9-4014-862f-247cdd601ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:42.168352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd684ad-46d9-4014-862f-247cdd601ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:42.279380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd684ad-46d9-4014-862f-247cdd601ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:42.281023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd684ad-46d9-4014-862f-247cdd601ce3 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:42.305624 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376982e96dd94a929bf1c14f63876960'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:42.306325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1094/2198] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:40:42.328506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376982e96dd94a929bf1c14f63876960'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:42.330897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376982e96dd94a929bf1c14f63876960'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:42.333577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376982e96dd94a929bf1c14f63876960'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:42.417584 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6d4c8454-b5e3-4e63-9ca6-ef64933e2215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376982e96dd94a929bf1c14f63876960'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:42.491118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1105/2199] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:41 2022] DELETE /identity/v3/users/376982e96dd94a929bf1c14f63876960 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:42.492826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea4cbe-ec1b-4dc2-b057-79716fec7c68 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:42.493118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea4cbe-ec1b-4dc2-b057-79716fec7c68 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:42.493399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea4cbe-ec1b-4dc2-b057-79716fec7c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:42.541349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e9ea4cbe-ec1b-4dc2-b057-79716fec7c68 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:42.545100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e9ea4cbe-ec1b-4dc2-b057-79716fec7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:42.634634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff28c5-cff0-4176-b6be-57451231bae9 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:42.634938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff28c5-cff0-4176-b6be-57451231bae9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:42.635226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff28c5-cff0-4176-b6be-57451231bae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:42.708969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c4ff28c5-cff0-4176-b6be-57451231bae9 None None] MFA Rules not processed for user `93aaa10edc614d4c8185b66c3934d295`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:42.710222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c4ff28c5-cff0-4176-b6be-57451231bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:42.783993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1095/2200] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:42.792490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea4cbe-ec1b-4dc2-b057-79716fec7c68 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:42.800289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e9ea4cbe-ec1b-4dc2-b057-79716fec7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:42.855743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1106/2201] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:43.047033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea4cbe-ec1b-4dc2-b057-79716fec7c68 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:43.074479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6883d4-1d61-48c7-ade4-104cb24e5865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:43.076101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6883d4-1d61-48c7-ade4-104cb24e5865 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:43.078575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6883d4-1d61-48c7-ade4-104cb24e5865 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:43.078876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6883d4-1d61-48c7-ade4-104cb24e5865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:43.125041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6883d4-1d61-48c7-ade4-104cb24e5865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:43.132782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6883d4-1d61-48c7-ade4-104cb24e5865 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:43.187797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1096/2202] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:40:43.945899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff28c5-cff0-4176-b6be-57451231bae9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:43.948148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c4ff28c5-cff0-4176-b6be-57451231bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:43.990678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff28c5-cff0-4176-b6be-57451231bae9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:43.998479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:44.015754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:44.015754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:44.015754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] PATH_INFO: `/v3/projects/1f91d5c21dce433fba4371f243db54b4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:44.016325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f91d5c21dce433fba4371f243db54b4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:44.018400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:44.253517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f91d5c21dce433fba4371f243db54b4', 'request_id': 'req-24eff4ef-a907-42f8-a7b6-788d2470832f'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:44.382777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f91d5c21dce433fba4371f243db54b4', 'request_id': 'req-24eff4ef-a907-42f8-a7b6-788d2470832f'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:44.390077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f91d5c21dce433fba4371f243db54b4', 'request_id': 'req-24eff4ef-a907-42f8-a7b6-788d2470832f'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:44.437800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] The token cache is being invalidate because project 1f91d5c21dce433fba4371f243db54b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:44.439026 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:44.439935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24eff4ef-a907-42f8-a7b6-788d2470832f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:44.441767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1107/2203] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:43 2022] DELETE /identity/v3/projects/1f91d5c21dce433fba4371f243db54b4 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:44.447568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe39d7-078a-4069-8051-07a0ca445a23 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:44.449238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe39d7-078a-4069-8051-07a0ca445a23 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:44.449923 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe39d7-078a-4069-8051-07a0ca445a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:44.483187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-abbe39d7-078a-4069-8051-07a0ca445a23 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:44.486851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-abbe39d7-078a-4069-8051-07a0ca445a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:44.624190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1097/2204] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:44.632595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383805f-4e07-4ae8-bb8f-171cd5342a4e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:44.633214 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383805f-4e07-4ae8-bb8f-171cd5342a4e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:44.633842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383805f-4e07-4ae8-bb8f-171cd5342a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:44.705935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-5383805f-4e07-4ae8-bb8f-171cd5342a4e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:44.707573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5383805f-4e07-4ae8-bb8f-171cd5342a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:44.778054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe39d7-078a-4069-8051-07a0ca445a23 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:44.778393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1108/2205] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:44.789221 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe39d7-078a-4069-8051-07a0ca445a23 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:44.803851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:44.805918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:44.806209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:44.806486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:44.807281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:44.807591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:44.812776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:44.843384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1098/2206] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:44.845099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383805f-4e07-4ae8-bb8f-171cd5342a4e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:44.866774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383805f-4e07-4ae8-bb8f-171cd5342a4e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:44.871148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f005f-ec3e-4067-9581-a5ef35c463ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:44.872453 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f005f-ec3e-4067-9581-a5ef35c463ac admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:44.873035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f005f-ec3e-4067-9581-a5ef35c463ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:44.873863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f005f-ec3e-4067-9581-a5ef35c463ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:44.875930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f005f-ec3e-4067-9581-a5ef35c463ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:44.878955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f005f-ec3e-4067-9581-a5ef35c463ac admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:45.494821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1109/2207] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:44 2022] POST /identity/v3/projects => generated 373 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:45.498687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:45.514128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e541f8a-3d6e-4827-8a55-310f32ee0ba3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:45.664939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8ffda-7753-4393-8c4b-a04da894c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:45.665931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8ffda-7753-4393-8c4b-a04da894c0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:45.666418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8ffda-7753-4393-8c4b-a04da894c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:45.667107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8ffda-7753-4393-8c4b-a04da894c0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:45.668030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8ffda-7753-4393-8c4b-a04da894c0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:45.684271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8ffda-7753-4393-8c4b-a04da894c0b9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:45.809683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1099/2208] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:45 2022] POST /identity/v3/users => generated 287 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:45.814367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f005f-ec3e-4067-9581-a5ef35c463ac admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:45.833191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f005f-ec3e-4067-9581-a5ef35c463ac admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:45.847231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603e992-a501-4885-a23b-2ab3202b0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:45.847933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603e992-a501-4885-a23b-2ab3202b0aff admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:45.848224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603e992-a501-4885-a23b-2ab3202b0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:45.848501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603e992-a501-4885-a23b-2ab3202b0aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:45.849851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603e992-a501-4885-a23b-2ab3202b0aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:45.853055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603e992-a501-4885-a23b-2ab3202b0aff admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:45.879014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1110/2209] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:45.886000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8ffda-7753-4393-8c4b-a04da894c0b9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:45.907888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8ffda-7753-4393-8c4b-a04da894c0b9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:45.918391 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1c3f2-8646-4369-a22d-fb092276d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:45.920582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c3f2-8646-4369-a22d-fb092276d1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:45.921095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c3f2-8646-4369-a22d-fb092276d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:45.921604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1c3f2-8646-4369-a22d-fb092276d1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:45.926400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1c3f2-8646-4369-a22d-fb092276d1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:45.928828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1c3f2-8646-4369-a22d-fb092276d1f7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:45.961137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1100/2210] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:45.964990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603e992-a501-4885-a23b-2ab3202b0aff admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:45.981100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603e992-a501-4885-a23b-2ab3202b0aff admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:45.988266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:45.989690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:45.990719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:45.991210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] PATH_INFO: `/v3/projects/d32d88e7b9de4e47a3c0b316c9a25ff6/users/86c86c7c6dbe473e8f7b59f99f75a5f5/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:46.030345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32d88e7b9de4e47a3c0b316c9a25ff6, user_id=86c86c7c6dbe473e8f7b59f99f75a5f5, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:46.033787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:46.166657 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1111/2211] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:45 2022] PUT /identity/v3/projects/d32d88e7b9de4e47a3c0b316c9a25ff6/users/86c86c7c6dbe473e8f7b59f99f75a5f5/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:46.175116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb92e-1137-4620-81e3-5cbfe2084524 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:46.175404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb92e-1137-4620-81e3-5cbfe2084524 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:46.176005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cb92e-1137-4620-81e3-5cbfe2084524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:46.280892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3b7cb92e-1137-4620-81e3-5cbfe2084524 None None] MFA Rules not processed for user `86c86c7c6dbe473e8f7b59f99f75a5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:46.283857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3b7cb92e-1137-4620-81e3-5cbfe2084524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:46.488132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1101/2212] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:46.532832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:46.535181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:46.691515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcccfde-0b99-4894-920d-ac92cb3be0d1 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:46.713815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c42bb-c97e-4570-adff-674d7c4f7ba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:46.714505 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c42bb-c97e-4570-adff-674d7c4f7ba8 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:46.735437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c42bb-c97e-4570-adff-674d7c4f7ba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:46.735437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c42bb-c97e-4570-adff-674d7c4f7ba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:46.735437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c42bb-c97e-4570-adff-674d7c4f7ba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:46.735437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c42bb-c97e-4570-adff-674d7c4f7ba8 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:46.748502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1112/2213] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:49.838065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cb92e-1137-4620-81e3-5cbfe2084524 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:49.839714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3b7cb92e-1137-4620-81e3-5cbfe2084524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:49.992027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cb92e-1137-4620-81e3-5cbfe2084524 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:50.000516 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:50.005827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:50.006855 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:50.007148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] PATH_INFO: `/v3/users/927bae2d8e164509acc35650259cd874` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:50.011837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=927bae2d8e164509acc35650259cd874)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:50.018776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:50.375154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927bae2d8e164509acc35650259cd874'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:50.375843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927bae2d8e164509acc35650259cd874'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:50.385118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927bae2d8e164509acc35650259cd874'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:50.385977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927bae2d8e164509acc35650259cd874'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:50.594907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927bae2d8e164509acc35650259cd874'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:50.619954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1102/2214] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:49 2022] DELETE /identity/v3/users/927bae2d8e164509acc35650259cd874 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:50.624490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a580-fd2d-4f19-9374-390dc10a1a69 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:50.625018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a580-fd2d-4f19-9374-390dc10a1a69 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:50.625104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312a580-fd2d-4f19-9374-390dc10a1a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:50.649076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b312a580-fd2d-4f19-9374-390dc10a1a69 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:50.650282 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b312a580-fd2d-4f19-9374-390dc10a1a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:50.710041 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1113/2215] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:50.719839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:50.721284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:50.777211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ad428-0f59-49f8-b502-73e5dba784d0 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:50.782672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:50.782672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:50.782672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:50.782672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:50.800451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:50.800451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:50.809044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1103/2216] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:51.215179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e31e1-61da-4583-8e2b-330f653a9c46 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:51.215741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e31e1-61da-4583-8e2b-330f653a9c46 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:51.216210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e31e1-61da-4583-8e2b-330f653a9c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:51.243744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:51.245358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:51.257387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-927e31e1-61da-4583-8e2b-330f653a9c46 None None] MFA Rules not processed for user `82bcd0d11bc346858946b46d4b65c047`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:51.259170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-927e31e1-61da-4583-8e2b-330f653a9c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:51.260540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e86e-fd4a-4446-b64c-9c6cfa07b4e7 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:51.266103 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:51.268772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:51.272335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:51.272335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] PATH_INFO: `/v3/projects/ee336f8313fc4c039a8ce25bbbd9d9e8` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:51.272335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee336f8313fc4c039a8ce25bbbd9d9e8)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:51.275590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:51.342961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1114/2217] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:51.497801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee336f8313fc4c039a8ce25bbbd9d9e8', 'request_id': 'req-e95ba1af-ad20-440c-ace2-f394b32dac74'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:51.587243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee336f8313fc4c039a8ce25bbbd9d9e8', 'request_id': 'req-e95ba1af-ad20-440c-ace2-f394b32dac74'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:51.594047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee336f8313fc4c039a8ce25bbbd9d9e8', 'request_id': 'req-e95ba1af-ad20-440c-ace2-f394b32dac74'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:51.605635 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] The token cache is being invalidate because project ee336f8313fc4c039a8ce25bbbd9d9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:51.605934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:51.606866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:51.608198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1104/2218] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:51 2022] DELETE /identity/v3/projects/ee336f8313fc4c039a8ce25bbbd9d9e8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:51.618677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e31e1-61da-4583-8e2b-330f653a9c46 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:51.625098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e31e1-61da-4583-8e2b-330f653a9c46 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:51.694131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:51.694991 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:51.695261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:51.695542 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] PATH_INFO: `/v3/users/1e7a8cef46dc40478a368bc41a82d9b9` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:51.696799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7a8cef46dc40478a368bc41a82d9b9)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:51.698764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:51.946740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7a8cef46dc40478a368bc41a82d9b9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:51.957354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7a8cef46dc40478a368bc41a82d9b9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:51.959304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7a8cef46dc40478a368bc41a82d9b9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:51.960336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7a8cef46dc40478a368bc41a82d9b9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:52.050028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6a053f83-0091-429f-b7b5-497e18373eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7a8cef46dc40478a368bc41a82d9b9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:52.072619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1115/2219] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:51 2022] DELETE /identity/v3/users/1e7a8cef46dc40478a368bc41a82d9b9 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:52.664693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:52.666294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:52.688706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba1af-ad20-440c-ace2-f394b32dac74 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:52.766571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:52.768846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:52.769537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:52.770046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] PATH_INFO: `/v3/projects/4e8fe579289743788fcacb9bcc7ffed7` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:52.771673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8fe579289743788fcacb9bcc7ffed7)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:52.774965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:52.898259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8fe579289743788fcacb9bcc7ffed7', 'request_id': 'req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:52.999279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8fe579289743788fcacb9bcc7ffed7', 'request_id': 'req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:53.012915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8fe579289743788fcacb9bcc7ffed7', 'request_id': 'req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:53.019789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] The token cache is being invalidate because project 4e8fe579289743788fcacb9bcc7ffed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:53.020305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:53.020983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-36ef3af3-9630-4060-9248-f4fc7f5d2ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:53.022824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1105/2220] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:52 2022] DELETE /identity/v3/projects/4e8fe579289743788fcacb9bcc7ffed7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:53.027792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401776-0f0a-4aef-9df1-da31aa37d663 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.028311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401776-0f0a-4aef-9df1-da31aa37d663 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.028428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2401776-0f0a-4aef-9df1-da31aa37d663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.060540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d2401776-0f0a-4aef-9df1-da31aa37d663 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:53.062361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d2401776-0f0a-4aef-9df1-da31aa37d663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:53.154581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1116/2221] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:53.159216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47841381-7c0b-488d-96bb-2121483abf26 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.159658 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47841381-7c0b-488d-96bb-2121483abf26 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.160090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47841381-7c0b-488d-96bb-2121483abf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.182260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-47841381-7c0b-488d-96bb-2121483abf26 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:53.186710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-47841381-7c0b-488d-96bb-2121483abf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:53.195090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1106/2222] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:53.199188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2401776-0f0a-4aef-9df1-da31aa37d663 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:53.210480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2401776-0f0a-4aef-9df1-da31aa37d663 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:53.220031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:53.220861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.221260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.221629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.222596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:53.222980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:53.224753 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:53.237832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1117/2223] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:40:53.242340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47841381-7c0b-488d-96bb-2121483abf26 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:53.253280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47841381-7c0b-488d-96bb-2121483abf26 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:53.258618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0233d2-2114-40cb-b58e-3ff9379ca7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:53.259334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0233d2-2114-40cb-b58e-3ff9379ca7ff admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.259625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0233d2-2114-40cb-b58e-3ff9379ca7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.260172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0233d2-2114-40cb-b58e-3ff9379ca7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.261134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0233d2-2114-40cb-b58e-3ff9379ca7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:53.264077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0233d2-2114-40cb-b58e-3ff9379ca7ff admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:53.381474 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1107/2224] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:53 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:53.382844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:53.393956 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abdc89-d41f-46b4-b4a5-55da6c7253f0 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:53.466609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16c5f3-dc52-45df-a98a-b47abc83c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:53.467286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16c5f3-dc52-45df-a98a-b47abc83c3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.467569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16c5f3-dc52-45df-a98a-b47abc83c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.467847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16c5f3-dc52-45df-a98a-b47abc83c3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.468561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16c5f3-dc52-45df-a98a-b47abc83c3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:53.470475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16c5f3-dc52-45df-a98a-b47abc83c3c8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:53.555321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1118/2225] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:53 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:53.559524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0233d2-2114-40cb-b58e-3ff9379ca7ff admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:53.604420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0233d2-2114-40cb-b58e-3ff9379ca7ff admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:53.616893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898c217-4a79-4a78-b27a-bed93f387333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:53.618386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c217-4a79-4a78-b27a-bed93f387333 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.618819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c217-4a79-4a78-b27a-bed93f387333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.619269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898c217-4a79-4a78-b27a-bed93f387333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.621162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898c217-4a79-4a78-b27a-bed93f387333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:53.623604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898c217-4a79-4a78-b27a-bed93f387333 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:53.652545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1108/2226] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:53.660570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16c5f3-dc52-45df-a98a-b47abc83c3c8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:53.671590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16c5f3-dc52-45df-a98a-b47abc83c3c8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:53.677076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22858-82da-4193-a8ec-110d9f539692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:53.678076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22858-82da-4193-a8ec-110d9f539692 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.678420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22858-82da-4193-a8ec-110d9f539692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.678740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22858-82da-4193-a8ec-110d9f539692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.679981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d22858-82da-4193-a8ec-110d9f539692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:53.682728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d22858-82da-4193-a8ec-110d9f539692 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:53.692670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1119/2227] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:53.696863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898c217-4a79-4a78-b27a-bed93f387333 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:53.711732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898c217-4a79-4a78-b27a-bed93f387333 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:53.717071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ea84-1c5f-4b50-8b65-0880ab8b9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:53.718323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ea84-1c5f-4b50-8b65-0880ab8b9992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.719368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ea84-1c5f-4b50-8b65-0880ab8b9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.719875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ea84-1c5f-4b50-8b65-0880ab8b9992 admin admin] PATH_INFO: `/v3/projects/031bffa81f9c4314b925770766177357/users/ab9cee6552354d5b906b86836a4477f6/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.740342 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92ea84-1c5f-4b50-8b65-0880ab8b9992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031bffa81f9c4314b925770766177357, user_id=ab9cee6552354d5b906b86836a4477f6, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:53.743528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92ea84-1c5f-4b50-8b65-0880ab8b9992 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:53.815908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1109/2228] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:53 2022] PUT /identity/v3/projects/031bffa81f9c4314b925770766177357/users/ab9cee6552354d5b906b86836a4477f6/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:53.830501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2367419-ba56-4aa3-836b-5cc0b619cc06 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:53.830501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2367419-ba56-4aa3-836b-5cc0b619cc06 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:53.830501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2367419-ba56-4aa3-836b-5cc0b619cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:53.862843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e2367419-ba56-4aa3-836b-5cc0b619cc06 None None] MFA Rules not processed for user `ab9cee6552354d5b906b86836a4477f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:53.865803 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e2367419-ba56-4aa3-836b-5cc0b619cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:53.974075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1120/2229] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:53.979674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ea84-1c5f-4b50-8b65-0880ab8b9992 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:54.056355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ea84-1c5f-4b50-8b65-0880ab8b9992 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:54.062041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b59239-5e1a-468d-928c-14e55d1b610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:54.063157 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b59239-5e1a-468d-928c-14e55d1b610a admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:54.063595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b59239-5e1a-468d-928c-14e55d1b610a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:54.064045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b59239-5e1a-468d-928c-14e55d1b610a admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:54.064903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b59239-5e1a-468d-928c-14e55d1b610a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:54.067331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b59239-5e1a-468d-928c-14e55d1b610a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:54.162570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1110/2230] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:53 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:40:54.169381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2367419-ba56-4aa3-836b-5cc0b619cc06 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:54.180684 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2367419-ba56-4aa3-836b-5cc0b619cc06 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:54.276165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de7ce-5cb2-40e2-a923-3caf2e676cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:54.276322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de7ce-5cb2-40e2-a923-3caf2e676cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:54.276600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de7ce-5cb2-40e2-a923-3caf2e676cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:54.277121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de7ce-5cb2-40e2-a923-3caf2e676cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:54.278019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46de7ce-5cb2-40e2-a923-3caf2e676cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:54.280281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46de7ce-5cb2-40e2-a923-3caf2e676cb7 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:54.373065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1121/2231] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:54 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:54.377153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b59239-5e1a-468d-928c-14e55d1b610a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:54.391966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b59239-5e1a-468d-928c-14e55d1b610a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:54.398957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac170-949b-4deb-9df3-cdb416175f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:54.399790 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac170-949b-4deb-9df3-cdb416175f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:54.400148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac170-949b-4deb-9df3-cdb416175f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:54.400497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dac170-949b-4deb-9df3-cdb416175f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:54.401316 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dac170-949b-4deb-9df3-cdb416175f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:54.404970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dac170-949b-4deb-9df3-cdb416175f0c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:54.429714 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1111/2232] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:54.429808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de7ce-5cb2-40e2-a923-3caf2e676cb7 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:54.441640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de7ce-5cb2-40e2-a923-3caf2e676cb7 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:54.447764 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e659dd-dfc6-4172-ab87-d440b6284a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:54.450355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e659dd-dfc6-4172-ab87-d440b6284a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:54.450787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e659dd-dfc6-4172-ab87-d440b6284a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:54.451175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e659dd-dfc6-4172-ab87-d440b6284a09 admin admin] PATH_INFO: `/v3/projects/71f55c5ffce642c7a72a8b9bd74ac722/users/c8b64f6524404207ab112d9c7001beab/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:54.478131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e659dd-dfc6-4172-ab87-d440b6284a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f55c5ffce642c7a72a8b9bd74ac722, user_id=c8b64f6524404207ab112d9c7001beab, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:54.480970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e659dd-dfc6-4172-ab87-d440b6284a09 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:54.553240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1122/2233] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:54 2022] PUT /identity/v3/projects/71f55c5ffce642c7a72a8b9bd74ac722/users/c8b64f6524404207ab112d9c7001beab/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:54.559589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac170-949b-4deb-9df3-cdb416175f0c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:54.583852 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dac170-949b-4deb-9df3-cdb416175f0c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:54.663270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca0c75-31f1-4378-94c4-fc8b66ff5f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:54.664107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0c75-31f1-4378-94c4-fc8b66ff5f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:54.664548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0c75-31f1-4378-94c4-fc8b66ff5f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:54.664813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0c75-31f1-4378-94c4-fc8b66ff5f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:54.665627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca0c75-31f1-4378-94c4-fc8b66ff5f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:54.667343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca0c75-31f1-4378-94c4-fc8b66ff5f3c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:54.680098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1112/2234] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:54.684307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e659dd-dfc6-4172-ab87-d440b6284a09 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:54.696320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e659dd-dfc6-4172-ab87-d440b6284a09 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:54.703982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:54.705308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:54.706311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:54.706818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] PATH_INFO: `/v3/projects/71f55c5ffce642c7a72a8b9bd74ac722/users/c8b64f6524404207ab112d9c7001beab/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:54.710004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f55c5ffce642c7a72a8b9bd74ac722, user_id=c8b64f6524404207ab112d9c7001beab, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:54.714031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:54.737538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1123/2235] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:54 2022] PUT /identity/v3/projects/71f55c5ffce642c7a72a8b9bd74ac722/users/c8b64f6524404207ab112d9c7001beab/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:54.741726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98688d7-95d3-4e32-957f-a94274a2b239 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:54.742251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98688d7-95d3-4e32-957f-a94274a2b239 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:54.742653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98688d7-95d3-4e32-957f-a94274a2b239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:54.775767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e98688d7-95d3-4e32-957f-a94274a2b239 None None] MFA Rules not processed for user `c8b64f6524404207ab112d9c7001beab`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:54.777114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e98688d7-95d3-4e32-957f-a94274a2b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:54.941724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1113/2236] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:54.949883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:54.951717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:55.022414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dadc39-8a16-4a2d-91f6-fa18a4b75686 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:55.025719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996ea9-741c-4d82-a73e-92349a60a2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:55.026522 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996ea9-741c-4d82-a73e-92349a60a2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:55.026843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996ea9-741c-4d82-a73e-92349a60a2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:55.027120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996ea9-741c-4d82-a73e-92349a60a2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:55.040425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996ea9-741c-4d82-a73e-92349a60a2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:55.043207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996ea9-741c-4d82-a73e-92349a60a2f4 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:55.067553 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1124/2237] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:55.217293 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089f02-0717-4d22-9db3-1e29444b73af None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:55.217604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089f02-0717-4d22-9db3-1e29444b73af None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:55.217980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089f02-0717-4d22-9db3-1e29444b73af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:55.247692 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-05089f02-0717-4d22-9db3-1e29444b73af None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:55.249240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-05089f02-0717-4d22-9db3-1e29444b73af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:55.287313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553330-efc4-40b2-ad93-d3376af7f2d5 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:55.287756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553330-efc4-40b2-ad93-d3376af7f2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:55.292691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553330-efc4-40b2-ad93-d3376af7f2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:55.327404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-dd553330-efc4-40b2-ad93-d3376af7f2d5 None None] MFA Rules not processed for user `788335ddb63f4b458dd3e5b38ea3a79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:55.327404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-dd553330-efc4-40b2-ad93-d3376af7f2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:55.421126 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1114/2238] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:55.444651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05089f02-0717-4d22-9db3-1e29444b73af None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:55.446353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-05089f02-0717-4d22-9db3-1e29444b73af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:55.482358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1125/2239] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:40:55.585884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05089f02-0717-4d22-9db3-1e29444b73af None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:55.592415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d7682-a35a-47f6-9f83-f7b3ee6a41d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:55.593597 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d7682-a35a-47f6-9f83-f7b3ee6a41d8 service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:55.593981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d7682-a35a-47f6-9f83-f7b3ee6a41d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:55.594388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d7682-a35a-47f6-9f83-f7b3ee6a41d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:55.619378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d7682-a35a-47f6-9f83-f7b3ee6a41d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:55.621483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d7682-a35a-47f6-9f83-f7b3ee6a41d8 service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:55.631894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1115/2240] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:40:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 16:40:55.929892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553330-efc4-40b2-ad93-d3376af7f2d5 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:56.107070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553330-efc4-40b2-ad93-d3376af7f2d5 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:56.133066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:56.139609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:56.140246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:56.142959 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] PATH_INFO: `/v3/users/ab9cee6552354d5b906b86836a4477f6` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:56.150241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9cee6552354d5b906b86836a4477f6)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:56.154422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:56.470881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9cee6552354d5b906b86836a4477f6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:56.504903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9cee6552354d5b906b86836a4477f6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:56.507863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9cee6552354d5b906b86836a4477f6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:56.509344 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9cee6552354d5b906b86836a4477f6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:56.575903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9cee6552354d5b906b86836a4477f6'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:56.606908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1126/2241] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:55 2022] DELETE /identity/v3/users/ab9cee6552354d5b906b86836a4477f6 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:56.614654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974ab87-9f3d-4301-9f80-a792544cdae4 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:56.616498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974ab87-9f3d-4301-9f80-a792544cdae4 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:56.617132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974ab87-9f3d-4301-9f80-a792544cdae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:56.640720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3974ab87-9f3d-4301-9f80-a792544cdae4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:56.641915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3974ab87-9f3d-4301-9f80-a792544cdae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:56.721217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1116/2242] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:56.735828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:56.737776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:56.838041 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2c3d-054c-4d1e-bb18-ce70b4d96d4b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:56.868994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca425-8c2c-4db4-bc8e-e57b376a6f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:56.868994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca425-8c2c-4db4-bc8e-e57b376a6f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:56.868994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca425-8c2c-4db4-bc8e-e57b376a6f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:56.868994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca425-8c2c-4db4-bc8e-e57b376a6f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:56.881331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fca425-8c2c-4db4-bc8e-e57b376a6f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:56.882852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fca425-8c2c-4db4-bc8e-e57b376a6f3a service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:56.896680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1127/2243] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:40:57.458705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974ab87-9f3d-4301-9f80-a792544cdae4 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:57.460783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3974ab87-9f3d-4301-9f80-a792544cdae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:57.501106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974ab87-9f3d-4301-9f80-a792544cdae4 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:57.524984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:57.533364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:57.533364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:57.533364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] PATH_INFO: `/v3/projects/031bffa81f9c4314b925770766177357` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:57.533364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=031bffa81f9c4314b925770766177357)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:57.552742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:57.742334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031bffa81f9c4314b925770766177357', 'request_id': 'req-aa8c8500-ad4a-4000-a815-dac6d771ed9c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:57.797873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031bffa81f9c4314b925770766177357', 'request_id': 'req-aa8c8500-ad4a-4000-a815-dac6d771ed9c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:57.804705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031bffa81f9c4314b925770766177357', 'request_id': 'req-aa8c8500-ad4a-4000-a815-dac6d771ed9c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:57.816090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] The token cache is being invalidate because project 031bffa81f9c4314b925770766177357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:57.816390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:57.817059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:57.818966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1117/2244] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:57 2022] DELETE /identity/v3/projects/031bffa81f9c4314b925770766177357 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:57.826220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca425-8c2c-4db4-bc8e-e57b376a6f3a service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:57.838051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca425-8c2c-4db4-bc8e-e57b376a6f3a service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:57.974326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:57.975356 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:57.975709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:57.976138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] PATH_INFO: `/v3/users/c8b64f6524404207ab112d9c7001beab` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:57.978386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b64f6524404207ab112d9c7001beab)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:57.982788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:58.188267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b64f6524404207ab112d9c7001beab'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:58.196404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b64f6524404207ab112d9c7001beab'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:58.197135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b64f6524404207ab112d9c7001beab'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:58.208425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b64f6524404207ab112d9c7001beab'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:58.279049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ae4e37e4-3e7a-4e03-9f62-3ad9c29bd492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b64f6524404207ab112d9c7001beab'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:58.301725 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1128/2245] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:40:57 2022] DELETE /identity/v3/users/c8b64f6524404207ab112d9c7001beab => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:58.881644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:58.883219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:58.900107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c8500-ad4a-4000-a815-dac6d771ed9c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:58.978879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:58.983085 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:58.983085 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:58.983085 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] PATH_INFO: `/v3/projects/71f55c5ffce642c7a72a8b9bd74ac722` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:58.983085 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f55c5ffce642c7a72a8b9bd74ac722)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:58.984682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:59.124944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f55c5ffce642c7a72a8b9bd74ac722', 'request_id': 'req-05830517-803d-49dd-afd3-1f8b2b19325c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:59.187136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f55c5ffce642c7a72a8b9bd74ac722', 'request_id': 'req-05830517-803d-49dd-afd3-1f8b2b19325c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:59.195532 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f55c5ffce642c7a72a8b9bd74ac722', 'request_id': 'req-05830517-803d-49dd-afd3-1f8b2b19325c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:59.220220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] The token cache is being invalidate because project 71f55c5ffce642c7a72a8b9bd74ac722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:40:59.220624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:59.221940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-05830517-803d-49dd-afd3-1f8b2b19325c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:40:59.230644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1118/2246] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:40:58 2022] DELETE /identity/v3/projects/71f55c5ffce642c7a72a8b9bd74ac722 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:40:59.233366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ae34-76b5-4da1-b22f-04d8abecd202 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:59.233881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ae34-76b5-4da1-b22f-04d8abecd202 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:59.234281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ae34-76b5-4da1-b22f-04d8abecd202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:59.271591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-40f7ae34-76b5-4da1-b22f-04d8abecd202 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:59.273090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-40f7ae34-76b5-4da1-b22f-04d8abecd202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:59.399685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1129/2247] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:59.408580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc462c-2e21-4968-bddd-18fead89170b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:59.409654 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc462c-2e21-4968-bddd-18fead89170b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:59.410090 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc462c-2e21-4968-bddd-18fead89170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:59.428979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-37bc462c-2e21-4968-bddd-18fead89170b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:40:59.430270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-37bc462c-2e21-4968-bddd-18fead89170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:40:59.438758 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1119/2248] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:40:59.443469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7ae34-76b5-4da1-b22f-04d8abecd202 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:59.462618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f7ae34-76b5-4da1-b22f-04d8abecd202 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:59.468790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:59.477864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:59.477864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:59.477864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:59.477864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:40:59.477864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:59.477864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:59.490571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1130/2249] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:40:59.491674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc462c-2e21-4968-bddd-18fead89170b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:59.501555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc462c-2e21-4968-bddd-18fead89170b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:59.506952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2258e-ef12-4411-af7f-061df86869cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:59.507986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2258e-ef12-4411-af7f-061df86869cb admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:59.508465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2258e-ef12-4411-af7f-061df86869cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:59.508931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2258e-ef12-4411-af7f-061df86869cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:59.509829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2258e-ef12-4411-af7f-061df86869cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:59.512506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2258e-ef12-4411-af7f-061df86869cb admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:59.627969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1120/2250] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:40:59 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:59.632435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:59.643798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d435b6-9f06-4773-896a-a8c87de6ceb6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:59.728175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311c95e-0a62-4f19-9ce5-c17ea0f2d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:59.728934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311c95e-0a62-4f19-9ce5-c17ea0f2d505 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:59.729225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311c95e-0a62-4f19-9ce5-c17ea0f2d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:59.729497 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311c95e-0a62-4f19-9ce5-c17ea0f2d505 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:59.730216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311c95e-0a62-4f19-9ce5-c17ea0f2d505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:59.732178 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311c95e-0a62-4f19-9ce5-c17ea0f2d505 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:59.817006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1131/2251] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:40:59 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:40:59.821203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2258e-ef12-4411-af7f-061df86869cb admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:59.833044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2258e-ef12-4411-af7f-061df86869cb admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:59.838098 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb47cde-69db-4307-839d-44d6e9a4ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:59.838823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47cde-69db-4307-839d-44d6e9a4ff25 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:59.839163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47cde-69db-4307-839d-44d6e9a4ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:59.839449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47cde-69db-4307-839d-44d6e9a4ff25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:59.840277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb47cde-69db-4307-839d-44d6e9a4ff25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:59.842371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb47cde-69db-4307-839d-44d6e9a4ff25 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:59.854847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1121/2252] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:40:59.858924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311c95e-0a62-4f19-9ce5-c17ea0f2d505 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:59.871421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311c95e-0a62-4f19-9ce5-c17ea0f2d505 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:59.876715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362112d-bb64-45ee-8207-1a2759e3ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:59.881044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362112d-bb64-45ee-8207-1a2759e3ce94 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:59.881044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362112d-bb64-45ee-8207-1a2759e3ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:59.881044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362112d-bb64-45ee-8207-1a2759e3ce94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:59.881044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362112d-bb64-45ee-8207-1a2759e3ce94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:59.881044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362112d-bb64-45ee-8207-1a2759e3ce94 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:40:59.898625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1132/2253] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:40:59.899922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb47cde-69db-4307-839d-44d6e9a4ff25 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:40:59.911373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb47cde-69db-4307-839d-44d6e9a4ff25 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:40:59.916468 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad5d78-8e17-48fb-bcc8-cb8c53fe74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:40:59.917360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5d78-8e17-48fb-bcc8-cb8c53fe74c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:40:59.917642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5d78-8e17-48fb-bcc8-cb8c53fe74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:40:59.917920 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5d78-8e17-48fb-bcc8-cb8c53fe74c9 admin admin] PATH_INFO: `/v3/projects/1f795374429743dd854821b15cc2e32e/users/3add49cf846341398b03f97a9562352a/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:40:59.945346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad5d78-8e17-48fb-bcc8-cb8c53fe74c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f795374429743dd854821b15cc2e32e, user_id=3add49cf846341398b03f97a9562352a, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:40:59.948242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad5d78-8e17-48fb-bcc8-cb8c53fe74c9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:00.016166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1122/2254] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:40:59 2022] PUT /identity/v3/projects/1f795374429743dd854821b15cc2e32e/users/3add49cf846341398b03f97a9562352a/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:00.028227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961b860-60bf-407f-94c0-d9ede391f627 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:00.028928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961b860-60bf-407f-94c0-d9ede391f627 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:00.029386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961b860-60bf-407f-94c0-d9ede391f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:00.063499 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-3961b860-60bf-407f-94c0-d9ede391f627 None None] MFA Rules not processed for user `3add49cf846341398b03f97a9562352a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:00.065292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3961b860-60bf-407f-94c0-d9ede391f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:00.131130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1133/2255] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:00.135967 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad5d78-8e17-48fb-bcc8-cb8c53fe74c9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:00.205179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad5d78-8e17-48fb-bcc8-cb8c53fe74c9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:00.211355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed8ac0-75ea-4725-8417-a975afc34e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:00.212332 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed8ac0-75ea-4725-8417-a975afc34e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:00.212836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed8ac0-75ea-4725-8417-a975afc34e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:00.213326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed8ac0-75ea-4725-8417-a975afc34e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:00.214293 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed8ac0-75ea-4725-8417-a975afc34e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:00.216605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed8ac0-75ea-4725-8417-a975afc34e01 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:00.276285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961b860-60bf-407f-94c0-d9ede391f627 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:00.277820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3961b860-60bf-407f-94c0-d9ede391f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:00.292648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961b860-60bf-407f-94c0-d9ede391f627 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:00.302574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:00.303183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:00.303721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:00.304361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] PATH_INFO: `/v3/users/86c86c7c6dbe473e8f7b59f99f75a5f5` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:00.306976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c86c7c6dbe473e8f7b59f99f75a5f5)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:00.309565 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:01.088720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1123/2256] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:41:00 2022] POST /identity/v3/projects => generated 375 bytes in 953 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:41:01.092771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed8ac0-75ea-4725-8417-a975afc34e01 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:01.180159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed8ac0-75ea-4725-8417-a975afc34e01 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:01.186049 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:01.186941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:01.187390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:01.187835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:01.188738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:01.191015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:01.230156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c86c7c6dbe473e8f7b59f99f75a5f5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:01.237193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c86c7c6dbe473e8f7b59f99f75a5f5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:01.242755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c86c7c6dbe473e8f7b59f99f75a5f5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:01.242755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c86c7c6dbe473e8f7b59f99f75a5f5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:01.290783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1124/2257] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:41:01 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:41:01.306862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:01.308984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:01.313394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-4f51703e-fa29-4950-9506-ee951d5445a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c86c7c6dbe473e8f7b59f99f75a5f5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:01.324668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a72c1-8760-4188-8c95-5405d5b27101 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:01.331406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b33d-fca4-4ee7-80ca-58cc3dfc48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:01.332521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b33d-fca4-4ee7-80ca-58cc3dfc48af admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:01.332998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b33d-fca4-4ee7-80ca-58cc3dfc48af admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:01.333419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b33d-fca4-4ee7-80ca-58cc3dfc48af admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:01.334222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801b33d-fca4-4ee7-80ca-58cc3dfc48af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:01.336104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801b33d-fca4-4ee7-80ca-58cc3dfc48af admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:01.341131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1134/2258] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:41:00 2022] DELETE /identity/v3/users/86c86c7c6dbe473e8f7b59f99f75a5f5 => generated 0 bytes in 1065 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:41:01.345572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d8aff-bfc3-46ef-b3e0-4eea3e045ee9 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:01.345866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d8aff-bfc3-46ef-b3e0-4eea3e045ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:01.346148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d8aff-bfc3-46ef-b3e0-4eea3e045ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:01.352014 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1125/2259] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:41:01.355783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b33d-fca4-4ee7-80ca-58cc3dfc48af admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:01.364178 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a09d8aff-bfc3-46ef-b3e0-4eea3e045ee9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:01.365469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a09d8aff-bfc3-46ef-b3e0-4eea3e045ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:01.366459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b33d-fca4-4ee7-80ca-58cc3dfc48af admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:01.440809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0ca6c-81b1-44c4-9786-330efede6dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:01.442017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ca6c-81b1-44c4-9786-330efede6dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:01.442459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ca6c-81b1-44c4-9786-330efede6dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:01.443175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ca6c-81b1-44c4-9786-330efede6dc6 admin admin] PATH_INFO: `/v3/projects/747ea4460e3f402c9d82299870f96a9c/users/7327366a73804889befa792526347bc4/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:01.469295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0ca6c-81b1-44c4-9786-330efede6dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747ea4460e3f402c9d82299870f96a9c, user_id=7327366a73804889befa792526347bc4, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:01.478457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1135/2260] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:41:01.489947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d8aff-bfc3-46ef-b3e0-4eea3e045ee9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:01.490175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0ca6c-81b1-44c4-9786-330efede6dc6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:01.491918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a09d8aff-bfc3-46ef-b3e0-4eea3e045ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:01.592479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1126/2261] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:41:01 2022] PUT /identity/v3/projects/747ea4460e3f402c9d82299870f96a9c/users/7327366a73804889befa792526347bc4/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:01.601865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0ca6c-81b1-44c4-9786-330efede6dc6 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:01.627815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d8aff-bfc3-46ef-b3e0-4eea3e045ee9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:01.692666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f8e4-3777-4d8c-ac9f-8c62b7e5e638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:01.693413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f8e4-3777-4d8c-ac9f-8c62b7e5e638 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:01.693822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f8e4-3777-4d8c-ac9f-8c62b7e5e638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:01.694095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f8e4-3777-4d8c-ac9f-8c62b7e5e638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:01.700792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0ca6c-81b1-44c4-9786-330efede6dc6 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:01.706233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4be718-5e58-47b7-8dfb-8013eda096f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:01.707048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4be718-5e58-47b7-8dfb-8013eda096f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:01.707451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4be718-5e58-47b7-8dfb-8013eda096f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:01.708003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4be718-5e58-47b7-8dfb-8013eda096f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:01.708128 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f8e4-3777-4d8c-ac9f-8c62b7e5e638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:01.708928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4be718-5e58-47b7-8dfb-8013eda096f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:01.709469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f8e4-3777-4d8c-ac9f-8c62b7e5e638 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:01.720293 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4be718-5e58-47b7-8dfb-8013eda096f9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:01.727250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1136/2262] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:01.745327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1127/2263] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:41:01.749436 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f8e4-3777-4d8c-ac9f-8c62b7e5e638 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:01.770726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f8e4-3777-4d8c-ac9f-8c62b7e5e638 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:01.781702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:01.783244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:01.783529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:01.783968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] PATH_INFO: `/v3/projects/747ea4460e3f402c9d82299870f96a9c/users/7327366a73804889befa792526347bc4/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:01.786111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747ea4460e3f402c9d82299870f96a9c, user_id=7327366a73804889befa792526347bc4, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:01.789151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:01.803472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1137/2264] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:41:01 2022] PUT /identity/v3/projects/747ea4460e3f402c9d82299870f96a9c/users/7327366a73804889befa792526347bc4/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:01.814333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf956-fd0a-4e50-85f8-5c4eb48ce748 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:01.815513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf956-fd0a-4e50-85f8-5c4eb48ce748 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:01.821613 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cf956-fd0a-4e50-85f8-5c4eb48ce748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:01.880096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-353cf956-fd0a-4e50-85f8-5c4eb48ce748 None None] MFA Rules not processed for user `7327366a73804889befa792526347bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:01.881361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-353cf956-fd0a-4e50-85f8-5c4eb48ce748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:01.970738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1128/2265] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:01.981642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:01.985580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:02.080387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5fe73-7ead-4df7-8e15-f4f887a58013 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:02.090570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177ef79-d273-476a-b793-b3c409347055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:02.091729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ef79-d273-476a-b793-b3c409347055 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:02.092199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ef79-d273-476a-b793-b3c409347055 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:02.092581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177ef79-d273-476a-b793-b3c409347055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:02.094670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6177ef79-d273-476a-b793-b3c409347055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:02.163749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177ef79-d273-476a-b793-b3c409347055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:02.165601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177ef79-d273-476a-b793-b3c409347055 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:02.182134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1138/2266] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:02.290454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cf956-fd0a-4e50-85f8-5c4eb48ce748 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:02.292422 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-353cf956-fd0a-4e50-85f8-5c4eb48ce748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:02.418008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cf956-fd0a-4e50-85f8-5c4eb48ce748 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:02.423920 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:02.425104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:02.425830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:02.426634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] PATH_INFO: `/v3/projects/d32d88e7b9de4e47a3c0b316c9a25ff6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:02.428166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32d88e7b9de4e47a3c0b316c9a25ff6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:02.430269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:02.567015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32d88e7b9de4e47a3c0b316c9a25ff6', 'request_id': 'req-952064f6-de6e-4cf8-b391-92d2cc952dc8'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:02.628550 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32d88e7b9de4e47a3c0b316c9a25ff6', 'request_id': 'req-952064f6-de6e-4cf8-b391-92d2cc952dc8'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:02.645434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32d88e7b9de4e47a3c0b316c9a25ff6', 'request_id': 'req-952064f6-de6e-4cf8-b391-92d2cc952dc8'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:02.660383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] The token cache is being invalidate because project d32d88e7b9de4e47a3c0b316c9a25ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:41:02.663548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:02.663548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-952064f6-de6e-4cf8-b391-92d2cc952dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:02.667651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1129/2267] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:41:02 2022] DELETE /identity/v3/projects/d32d88e7b9de4e47a3c0b316c9a25ff6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:02.669346 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050aebe9-f9ab-48ec-af61-b16b93b1154d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:02.669853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050aebe9-f9ab-48ec-af61-b16b93b1154d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:02.669976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050aebe9-f9ab-48ec-af61-b16b93b1154d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:02.698016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-050aebe9-f9ab-48ec-af61-b16b93b1154d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:02.699643 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-050aebe9-f9ab-48ec-af61-b16b93b1154d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:02.798233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1139/2268] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:02.799228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5189cd-7d08-4fb2-81d2-3ea4e3cc3a03 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:02.799527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5189cd-7d08-4fb2-81d2-3ea4e3cc3a03 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:02.799815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5189cd-7d08-4fb2-81d2-3ea4e3cc3a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:02.819627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9d5189cd-7d08-4fb2-81d2-3ea4e3cc3a03 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:02.820868 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9d5189cd-7d08-4fb2-81d2-3ea4e3cc3a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:02.842592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1130/2269] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:41:02.843919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050aebe9-f9ab-48ec-af61-b16b93b1154d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:02.857129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050aebe9-f9ab-48ec-af61-b16b93b1154d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:02.871286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:02.872108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:02.872470 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:02.872856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:02.873699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:41:02.874091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:02.875836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:02.895936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1140/2270] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:41:02.905762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5189cd-7d08-4fb2-81d2-3ea4e3cc3a03 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:02.920119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5189cd-7d08-4fb2-81d2-3ea4e3cc3a03 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:02.927410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf35b7-3696-4a26-8d2e-d0561e81763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:02.928248 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf35b7-3696-4a26-8d2e-d0561e81763a admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:02.928701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf35b7-3696-4a26-8d2e-d0561e81763a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:02.929198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf35b7-3696-4a26-8d2e-d0561e81763a admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:02.929975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf35b7-3696-4a26-8d2e-d0561e81763a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:02.932296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf35b7-3696-4a26-8d2e-d0561e81763a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:03.075005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1131/2271] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:41:02 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:41:03.078039 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:03.094529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4d297-d778-4a5b-8150-0d4a0d8e9ca6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:03.257090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462b44-8372-404b-93ac-70c1fc147ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:03.257873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462b44-8372-404b-93ac-70c1fc147ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:03.258218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462b44-8372-404b-93ac-70c1fc147ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:03.258594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462b44-8372-404b-93ac-70c1fc147ecc admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:03.264185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98462b44-8372-404b-93ac-70c1fc147ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:03.264185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98462b44-8372-404b-93ac-70c1fc147ecc admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:03.339376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1141/2272] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:41:03 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:41:03.343482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf35b7-3696-4a26-8d2e-d0561e81763a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:03.361477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf35b7-3696-4a26-8d2e-d0561e81763a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:03.368121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca86c-8053-4d98-8083-5762ee459103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:03.368121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca86c-8053-4d98-8083-5762ee459103 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:03.368362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca86c-8053-4d98-8083-5762ee459103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:03.368672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca86c-8053-4d98-8083-5762ee459103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:03.369638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ca86c-8053-4d98-8083-5762ee459103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:03.371483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ca86c-8053-4d98-8083-5762ee459103 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:03.383312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1132/2273] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:41:03.387418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462b44-8372-404b-93ac-70c1fc147ecc admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:03.411327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462b44-8372-404b-93ac-70c1fc147ecc admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:03.416742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fed954-2be5-4713-838c-6b87aa00613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:03.417426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed954-2be5-4713-838c-6b87aa00613e admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:03.417717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed954-2be5-4713-838c-6b87aa00613e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:03.418000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fed954-2be5-4713-838c-6b87aa00613e admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:03.418778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fed954-2be5-4713-838c-6b87aa00613e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:03.420427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fed954-2be5-4713-838c-6b87aa00613e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:03.432510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1142/2274] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:41:03.437019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca86c-8053-4d98-8083-5762ee459103 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:03.461507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca86c-8053-4d98-8083-5762ee459103 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:03.473715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:03.475141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:03.476326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:03.476846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] PATH_INFO: `/v3/projects/06de2697b6a24554aacc026dbd32cd46/users/3b3b7cf50b844d94948110080a7eaed4/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:03.505115 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06de2697b6a24554aacc026dbd32cd46, user_id=3b3b7cf50b844d94948110080a7eaed4, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:03.508123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:03.595665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1133/2275] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:41:03 2022] PUT /identity/v3/projects/06de2697b6a24554aacc026dbd32cd46/users/3b3b7cf50b844d94948110080a7eaed4/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:03.601640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29fd50-572d-4d5d-8201-3521411cf2eb None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:03.602247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29fd50-572d-4d5d-8201-3521411cf2eb None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:03.602629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29fd50-572d-4d5d-8201-3521411cf2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:03.621590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8a29fd50-572d-4d5d-8201-3521411cf2eb None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:03.622843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8a29fd50-572d-4d5d-8201-3521411cf2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:03.718513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1143/2276] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:41:03.727002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:03.728770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:03.827985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62fb8d-194f-4692-a96e-03ff510ba29e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:03.841267 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f4ac8-c14b-4602-8c1e-54be6ff6eefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:03.841960 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4ac8-c14b-4602-8c1e-54be6ff6eefc service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:03.842255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4ac8-c14b-4602-8c1e-54be6ff6eefc service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:03.842567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4ac8-c14b-4602-8c1e-54be6ff6eefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:03.855397 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f4ac8-c14b-4602-8c1e-54be6ff6eefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:03.857046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f4ac8-c14b-4602-8c1e-54be6ff6eefc service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:03.871172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1134/2277] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:05.549946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29fd50-572d-4d5d-8201-3521411cf2eb None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:05.551603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8a29fd50-572d-4d5d-8201-3521411cf2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:05.585156 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29fd50-572d-4d5d-8201-3521411cf2eb None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:05.601036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:05.604973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:05.605482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:05.606123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] PATH_INFO: `/v3/users/3add49cf846341398b03f97a9562352a` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:05.613206 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3add49cf846341398b03f97a9562352a)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:05.615793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:05.901718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3add49cf846341398b03f97a9562352a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:05.913584 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3add49cf846341398b03f97a9562352a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:05.913584 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3add49cf846341398b03f97a9562352a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:05.914367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3add49cf846341398b03f97a9562352a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:05.993802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3add49cf846341398b03f97a9562352a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:06.018879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1144/2278] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:41:05 2022] DELETE /identity/v3/users/3add49cf846341398b03f97a9562352a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:06.023614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af59e3-b21c-475f-8b20-b65e8b0ae31f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:06.024070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af59e3-b21c-475f-8b20-b65e8b0ae31f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:06.024223 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af59e3-b21c-475f-8b20-b65e8b0ae31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:06.076184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-60af59e3-b21c-475f-8b20-b65e8b0ae31f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:06.078652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-60af59e3-b21c-475f-8b20-b65e8b0ae31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:06.154128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1135/2279] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:06.197906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:06.199826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:06.322792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41725cfd-9f05-46cb-959f-cbdf3a503b28 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:06.327241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105ae0-192c-412e-9eac-a123f5c5579b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:06.328097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105ae0-192c-412e-9eac-a123f5c5579b service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:06.328437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105ae0-192c-412e-9eac-a123f5c5579b service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:06.328786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48105ae0-192c-412e-9eac-a123f5c5579b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:06.341669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48105ae0-192c-412e-9eac-a123f5c5579b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:06.350500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48105ae0-192c-412e-9eac-a123f5c5579b service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:06.372443 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1145/2280] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:07.059208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af59e3-b21c-475f-8b20-b65e8b0ae31f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:07.060753 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-60af59e3-b21c-475f-8b20-b65e8b0ae31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:07.075060 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af59e3-b21c-475f-8b20-b65e8b0ae31f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:07.085723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:07.087771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:07.087876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:07.088159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] PATH_INFO: `/v3/projects/1f795374429743dd854821b15cc2e32e` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:07.097825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f795374429743dd854821b15cc2e32e)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:07.101522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:07.228257 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f795374429743dd854821b15cc2e32e', 'request_id': 'req-21ef87b3-5552-4137-8ad1-3ca9b6d28938'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.307632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f795374429743dd854821b15cc2e32e', 'request_id': 'req-21ef87b3-5552-4137-8ad1-3ca9b6d28938'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.317045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f795374429743dd854821b15cc2e32e', 'request_id': 'req-21ef87b3-5552-4137-8ad1-3ca9b6d28938'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.338039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] The token cache is being invalidate because project 1f795374429743dd854821b15cc2e32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:41:07.338346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.339088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-21ef87b3-5552-4137-8ad1-3ca9b6d28938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.359156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1136/2281] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:41:07 2022] DELETE /identity/v3/projects/1f795374429743dd854821b15cc2e32e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:07.361380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105ae0-192c-412e-9eac-a123f5c5579b service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:07.372635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48105ae0-192c-412e-9eac-a123f5c5579b service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:07.499737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:07.502974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:07.503495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:07.504890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] PATH_INFO: `/v3/users/7327366a73804889befa792526347bc4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:07.508385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7327366a73804889befa792526347bc4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:07.511669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:07.751231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7327366a73804889befa792526347bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.772561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7327366a73804889befa792526347bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.773413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7327366a73804889befa792526347bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.774060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7327366a73804889befa792526347bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.851898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7327366a73804889befa792526347bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:07.919569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1146/2282] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:41:07 2022] DELETE /identity/v3/users/7327366a73804889befa792526347bc4 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:07.928380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04419b4-8728-4471-ba47-4541ee1054cf None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:07.928994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04419b4-8728-4471-ba47-4541ee1054cf None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:07.929536 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04419b4-8728-4471-ba47-4541ee1054cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:08.043662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-d04419b4-8728-4471-ba47-4541ee1054cf None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:08.044942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d04419b4-8728-4471-ba47-4541ee1054cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:08.211924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1137/2283] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:08.231453 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:08.233698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:08.397140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604e0c-5790-462e-93d7-078662b378e8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:08.404142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eea2e3-2a0d-4555-89b4-62561b776e9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:08.409235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eea2e3-2a0d-4555-89b4-62561b776e9a service swift] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:08.409235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eea2e3-2a0d-4555-89b4-62561b776e9a service swift] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:08.409235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eea2e3-2a0d-4555-89b4-62561b776e9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:08.418075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eea2e3-2a0d-4555-89b4-62561b776e9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:08.420907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eea2e3-2a0d-4555-89b4-62561b776e9a service swift] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:08.444320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1147/2284] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:41:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:41:10.455074 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04419b4-8728-4471-ba47-4541ee1054cf None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:10.456647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d04419b4-8728-4471-ba47-4541ee1054cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:10.615536 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04419b4-8728-4471-ba47-4541ee1054cf None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:10.620842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:10.621793 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:10.622089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:10.622417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] PATH_INFO: `/v3/projects/747ea4460e3f402c9d82299870f96a9c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:10.624238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] RBAC: Authorizing `identity:delete_project(project_id=747ea4460e3f402c9d82299870f96a9c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:10.628056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:10.845272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747ea4460e3f402c9d82299870f96a9c', 'request_id': 'req-f198b1af-be81-4202-ad8d-1456a810353b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:10.925479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747ea4460e3f402c9d82299870f96a9c', 'request_id': 'req-f198b1af-be81-4202-ad8d-1456a810353b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:10.933647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747ea4460e3f402c9d82299870f96a9c', 'request_id': 'req-f198b1af-be81-4202-ad8d-1456a810353b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:10.960984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] The token cache is being invalidate because project 747ea4460e3f402c9d82299870f96a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:41:10.962005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:10.963038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:41:10.965320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1138/2285] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:41:10 2022] DELETE /identity/v3/projects/747ea4460e3f402c9d82299870f96a9c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:15.425415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df34d9-1002-498c-90a5-1044f0680577 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:15.430569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df34d9-1002-498c-90a5-1044f0680577 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:15.430569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df34d9-1002-498c-90a5-1044f0680577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:15.462013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f0df34d9-1002-498c-90a5-1044f0680577 None None] MFA Rules not processed for user `3b3b7cf50b844d94948110080a7eaed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:15.463703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f0df34d9-1002-498c-90a5-1044f0680577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:15.566060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1148/2286] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:15.567161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:15.569393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:15.731475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198b1af-be81-4202-ad8d-1456a810353b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:15.746906 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf586c-1437-4b60-9389-1ee3a59a0bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:15.747776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf586c-1437-4b60-9389-1ee3a59a0bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:15.748322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf586c-1437-4b60-9389-1ee3a59a0bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:15.748826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf586c-1437-4b60-9389-1ee3a59a0bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:15.750279 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf586c-1437-4b60-9389-1ee3a59a0bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:15.753189 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf586c-1437-4b60-9389-1ee3a59a0bd4 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:15.865023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1139/2287] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:41:15 2022] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:41:15.869161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df34d9-1002-498c-90a5-1044f0680577 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:15.890339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df34d9-1002-498c-90a5-1044f0680577 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:15.979946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e6ea1-4870-4ea9-9022-cab8ebadbbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:15.979946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6ea1-4870-4ea9-9022-cab8ebadbbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:15.990220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6ea1-4870-4ea9-9022-cab8ebadbbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:15.990616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e6ea1-4870-4ea9-9022-cab8ebadbbd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:15.991396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e6ea1-4870-4ea9-9022-cab8ebadbbd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:16.000891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e6ea1-4870-4ea9-9022-cab8ebadbbd0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:16.134239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1149/2288] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:41:15 2022] POST /identity/v3/users => generated 296 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:41:16.135715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf586c-1437-4b60-9389-1ee3a59a0bd4 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:16.153585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf586c-1437-4b60-9389-1ee3a59a0bd4 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:16.168432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb45295-c063-4205-b7ad-79206da9a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:16.169283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb45295-c063-4205-b7ad-79206da9a29f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:16.175885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb45295-c063-4205-b7ad-79206da9a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:16.175885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb45295-c063-4205-b7ad-79206da9a29f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:16.175885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb45295-c063-4205-b7ad-79206da9a29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:16.175885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb45295-c063-4205-b7ad-79206da9a29f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:16.202198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1140/2289] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:41:16.209447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e6ea1-4870-4ea9-9022-cab8ebadbbd0 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:16.239409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e6ea1-4870-4ea9-9022-cab8ebadbbd0 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:16.283080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c297f-c836-4a4e-a60f-e3973ca880c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:16.286779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c297f-c836-4a4e-a60f-e3973ca880c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:16.287075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c297f-c836-4a4e-a60f-e3973ca880c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:16.287358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c297f-c836-4a4e-a60f-e3973ca880c0 admin admin] PATH_INFO: `/v3/projects/67872c73a9e74f55803e5fe1e4763b32/users/90e076c5ccb54342b84041a1adbf91a4/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:16.322418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c297f-c836-4a4e-a60f-e3973ca880c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67872c73a9e74f55803e5fe1e4763b32, user_id=90e076c5ccb54342b84041a1adbf91a4, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:16.325315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c297f-c836-4a4e-a60f-e3973ca880c0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:16.405215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1150/2290] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:41:16 2022] PUT /identity/v3/projects/67872c73a9e74f55803e5fe1e4763b32/users/90e076c5ccb54342b84041a1adbf91a4/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:16.409634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb45295-c063-4205-b7ad-79206da9a29f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:16.424415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb45295-c063-4205-b7ad-79206da9a29f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:16.575040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a2c7d-14bb-4e25-81de-4487458e3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:16.577990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a2c7d-14bb-4e25-81de-4487458e3d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:16.578633 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a2c7d-14bb-4e25-81de-4487458e3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:16.579857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a2c7d-14bb-4e25-81de-4487458e3d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:16.581394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a2c7d-14bb-4e25-81de-4487458e3d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:16.586705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a2c7d-14bb-4e25-81de-4487458e3d0a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:16.602787 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1141/2291] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:41:16.606834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c297f-c836-4a4e-a60f-e3973ca880c0 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:16.622306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c297f-c836-4a4e-a60f-e3973ca880c0 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:16.633512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:16.636850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:16.636850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:16.636850 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] PATH_INFO: `/v3/projects/67872c73a9e74f55803e5fe1e4763b32/users/90e076c5ccb54342b84041a1adbf91a4/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:16.639258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67872c73a9e74f55803e5fe1e4763b32, user_id=90e076c5ccb54342b84041a1adbf91a4, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:16.644145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:16.664726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1151/2292] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:41:16 2022] PUT /identity/v3/projects/67872c73a9e74f55803e5fe1e4763b32/users/90e076c5ccb54342b84041a1adbf91a4/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:41:27.328378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9660a8-8c08-4082-8145-d12dae0e1f93 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:27.329062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9660a8-8c08-4082-8145-d12dae0e1f93 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:27.329327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9660a8-8c08-4082-8145-d12dae0e1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:27.363170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9c9660a8-8c08-4082-8145-d12dae0e1f93 None None] MFA Rules not processed for user `90e076c5ccb54342b84041a1adbf91a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:27.364429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9c9660a8-8c08-4082-8145-d12dae0e1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:27.439355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1142/2293] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:27.453691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:27.456258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:27.609682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc2c7-c3ca-410f-b544-a30101cbe512 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:27.615769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1eb72f-d28e-48e6-8638-938553ab2740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:27.616580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eb72f-d28e-48e6-8638-938553ab2740 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:27.616935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eb72f-d28e-48e6-8638-938553ab2740 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:27.617284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1eb72f-d28e-48e6-8638-938553ab2740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:27.691098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1eb72f-d28e-48e6-8638-938553ab2740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:27.693913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1eb72f-d28e-48e6-8638-938553ab2740 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:27.702495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1152/2294] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:41:33.843402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9660a8-8c08-4082-8145-d12dae0e1f93 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:33.844946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9c9660a8-8c08-4082-8145-d12dae0e1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:33.904143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9660a8-8c08-4082-8145-d12dae0e1f93 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:33.908365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741860-247f-42dc-abc7-d5d8b1b163c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:33.909047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741860-247f-42dc-abc7-d5d8b1b163c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:33.909336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741860-247f-42dc-abc7-d5d8b1b163c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:33.909652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741860-247f-42dc-abc7-d5d8b1b163c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:33.912064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-51741860-247f-42dc-abc7-d5d8b1b163c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:33.980340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741860-247f-42dc-abc7-d5d8b1b163c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:33.982195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741860-247f-42dc-abc7-d5d8b1b163c1 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:33.992721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1143/2295] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:34.417662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100995-ba38-425e-b729-2df8dd95ab5c None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:34.418138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100995-ba38-425e-b729-2df8dd95ab5c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:34.418308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100995-ba38-425e-b729-2df8dd95ab5c None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:34.419768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1153/2296] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:41:34.425922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63cf77-d5aa-4b5d-8628-892c239a3d79 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:34.426310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63cf77-d5aa-4b5d-8628-892c239a3d79 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:34.426677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63cf77-d5aa-4b5d-8628-892c239a3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:34.465879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1c63cf77-d5aa-4b5d-8628-892c239a3d79 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:34.467315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1c63cf77-d5aa-4b5d-8628-892c239a3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:34.478246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1144/2297] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:34.490161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100995-ba38-425e-b729-2df8dd95ab5c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:34.492226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-66100995-ba38-425e-b729-2df8dd95ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:34.582779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100995-ba38-425e-b729-2df8dd95ab5c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:34.587169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ff7a6-a09b-4ca6-8d2a-cdae4eb9f60c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f2a360a89548208edd5fdff1a04e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:34.587918 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff7a6-a09b-4ca6-8d2a-cdae4eb9f60c service glance] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:34.588228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff7a6-a09b-4ca6-8d2a-cdae4eb9f60c service glance] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:34.588566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ff7a6-a09b-4ca6-8d2a-cdae4eb9f60c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:34.600227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ff7a6-a09b-4ca6-8d2a-cdae4eb9f60c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:34.601663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ff7a6-a09b-4ca6-8d2a-cdae4eb9f60c service glance] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:34.613325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1154/2298] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:34.811368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99da1-ba1e-42c8-96b5-4e10f770302b None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:34.811694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99da1-ba1e-42c8-96b5-4e10f770302b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:34.811948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be99da1-ba1e-42c8-96b5-4e10f770302b None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:34.813359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1145/2299] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:41:34.818923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd921-b0f8-4be2-b912-f72ea2216e3c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:34.819197 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd921-b0f8-4be2-b912-f72ea2216e3c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:34.819478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd921-b0f8-4be2-b912-f72ea2216e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:34.839410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-30ffd921-b0f8-4be2-b912-f72ea2216e3c None None] MFA Rules not processed for user `ebf1f55dbef94868aaac6d39ed70690b`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:34.841045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-30ffd921-b0f8-4be2-b912-f72ea2216e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:34.848398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1155/2300] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:34.860151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be99da1-ba1e-42c8-96b5-4e10f770302b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:34.862703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2be99da1-ba1e-42c8-96b5-4e10f770302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:34.878881 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be99da1-ba1e-42c8-96b5-4e10f770302b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:34.882588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9caa3-1d85-4fe2-931f-46ad1e6c9db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:34.883243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9caa3-1d85-4fe2-931f-46ad1e6c9db6 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:34.883744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9caa3-1d85-4fe2-931f-46ad1e6c9db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:34.884038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9caa3-1d85-4fe2-931f-46ad1e6c9db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:34.891818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9caa3-1d85-4fe2-931f-46ad1e6c9db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:34.893673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9caa3-1d85-4fe2-931f-46ad1e6c9db6 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:34.903173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1146/2301] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:34.992035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b30b0-6d1d-46bc-9b77-9c634dcf005a None None] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:34.992326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b30b0-6d1d-46bc-9b77-9c634dcf005a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:34.992721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b30b0-6d1d-46bc-9b77-9c634dcf005a None None] PATH_INFO: `/` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:34.994717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1156/2302] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:41:35.001131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc00c-0462-4559-8488-53fb3ea64dc8 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:35.001460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc00c-0462-4559-8488-53fb3ea64dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:35.002419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc00c-0462-4559-8488-53fb3ea64dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:35.021265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-37bfc00c-0462-4559-8488-53fb3ea64dc8 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:35.022483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-37bfc00c-0462-4559-8488-53fb3ea64dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:35.033365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1147/2303] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:35.044965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b30b0-6d1d-46bc-9b77-9c634dcf005a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:35.065063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b30b0-6d1d-46bc-9b77-9c634dcf005a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:35.070792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:35.071422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:35.071715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:35.071996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:35.083828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:35.085305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:35.101256 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1157/2304] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:38.781466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc00c-0462-4559-8488-53fb3ea64dc8 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:38.791581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc00c-0462-4559-8488-53fb3ea64dc8 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:38.795319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8fdc7-8044-43bc-bfe0-9461b3e161e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:38.795990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fdc7-8044-43bc-bfe0-9461b3e161e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:38.796256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fdc7-8044-43bc-bfe0-9461b3e161e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:38.796552 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fdc7-8044-43bc-bfe0-9461b3e161e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:38.798329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a6a8fdc7-8044-43bc-bfe0-9461b3e161e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:38.862019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8fdc7-8044-43bc-bfe0-9461b3e161e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:38.863414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8fdc7-8044-43bc-bfe0-9461b3e161e2 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:38.872844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1148/2305] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:46.744531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:46.746413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:46.836117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc141-6ac8-43e0-b588-1ea319f5aed2 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:46.841239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c62b7-608e-4650-a8bc-e2d015eea829 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded012db549b45669a4ffcdd988b55ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:46.841882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c62b7-608e-4650-a8bc-e2d015eea829 service placement] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:46.842191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c62b7-608e-4650-a8bc-e2d015eea829 service placement] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:46.842467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c62b7-608e-4650-a8bc-e2d015eea829 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:46.844354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f23c62b7-608e-4650-a8bc-e2d015eea829 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:46.856716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c62b7-608e-4650-a8bc-e2d015eea829 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:46.858320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c62b7-608e-4650-a8bc-e2d015eea829 service placement] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:46.870900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1158/2306] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:41:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:41:48.034985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7fbbe-bdca-4a60-823a-2493be4db8cc None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:48.035514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7fbbe-bdca-4a60-823a-2493be4db8cc None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:48.035514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7fbbe-bdca-4a60-823a-2493be4db8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:48.053836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-0be7fbbe-bdca-4a60-823a-2493be4db8cc None None] MFA Rules not processed for user `50998395da9a417eaa555e714c998496`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:48.055093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0be7fbbe-bdca-4a60-823a-2493be4db8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:48.115732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1149/2307] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:48.845175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605acc6-2023-4407-b24c-1bcf50334034 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:48.845663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605acc6-2023-4407-b24c-1bcf50334034 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:48.845771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605acc6-2023-4407-b24c-1bcf50334034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:48.864007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1605acc6-2023-4407-b24c-1bcf50334034 None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:48.865226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1605acc6-2023-4407-b24c-1bcf50334034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:48.918411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1159/2308] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:41:48.943740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7fbbe-bdca-4a60-823a-2493be4db8cc None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:41:48.947465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0be7fbbe-bdca-4a60-823a-2493be4db8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:49.021435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7fbbe-bdca-4a60-823a-2493be4db8cc None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:41:49.026615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70300c-65dd-4c7a-9c37-26e8439ae0f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:41:49.027271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70300c-65dd-4c7a-9c37-26e8439ae0f6 service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:49.027665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70300c-65dd-4c7a-9c37-26e8439ae0f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:49.027983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70300c-65dd-4c7a-9c37-26e8439ae0f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:49.036809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70300c-65dd-4c7a-9c37-26e8439ae0f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:41:49.039175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70300c-65dd-4c7a-9c37-26e8439ae0f6 service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:41:49.048916 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1150/2309] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:41:50.973853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056de1-f01b-47b7-9a16-95280736bf2b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:41:50.974468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056de1-f01b-47b7-9a16-95280736bf2b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:41:50.974468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056de1-f01b-47b7-9a16-95280736bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:41:50.993129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-7c056de1-f01b-47b7-9a16-95280736bf2b None None] MFA Rules not processed for user `3b3b7cf50b844d94948110080a7eaed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:41:50.994480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-7c056de1-f01b-47b7-9a16-95280736bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:41:51.002649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1160/2310] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:41:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:42:14.340859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051158f-48d4-494c-a42b-226b7bbbe01c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:42:14.341439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051158f-48d4-494c-a42b-226b7bbbe01c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:42:14.341439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051158f-48d4-494c-a42b-226b7bbbe01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:42:14.362720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9051158f-48d4-494c-a42b-226b7bbbe01c None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:42:14.364581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9051158f-48d4-494c-a42b-226b7bbbe01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:42:14.372769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1151/2311] 10.222.0.43 () {58 vars in 967 bytes} [Thu Apr 28 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:42:14.393937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c056de1-f01b-47b7-9a16-95280736bf2b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:42:14.412552 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c056de1-f01b-47b7-9a16-95280736bf2b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:42:14.418606 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183b5bc-11bc-447b-81cd-4060d79e9946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:42:14.419636 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183b5bc-11bc-447b-81cd-4060d79e9946 service swift] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:42:14.420077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183b5bc-11bc-447b-81cd-4060d79e9946 service swift] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:42:14.420513 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183b5bc-11bc-447b-81cd-4060d79e9946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:42:14.431665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183b5bc-11bc-447b-81cd-4060d79e9946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:42:14.433649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183b5bc-11bc-447b-81cd-4060d79e9946 service swift] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:42:14.445013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1161/2312] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:42:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:42:22.200281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051158f-48d4-494c-a42b-226b7bbbe01c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:42:22.209717 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051158f-48d4-494c-a42b-226b7bbbe01c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:42:22.213296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9a1b3-6204-448c-8211-06ba9ef63678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:42:22.213940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9a1b3-6204-448c-8211-06ba9ef63678 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:42:22.214224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9a1b3-6204-448c-8211-06ba9ef63678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:42:22.214506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9a1b3-6204-448c-8211-06ba9ef63678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:42:22.223450 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9a1b3-6204-448c-8211-06ba9ef63678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:42:22.224872 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9a1b3-6204-448c-8211-06ba9ef63678 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:42:22.234693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1152/2313] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:43:14.022475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d019a-1f94-479c-9e24-ab639d49eea1 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:14.023096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d019a-1f94-479c-9e24-ab639d49eea1 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:14.023205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d019a-1f94-479c-9e24-ab639d49eea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:14.040887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-034d019a-1f94-479c-9e24-ab639d49eea1 None None] MFA Rules not processed for user `788335ddb63f4b458dd3e5b38ea3a79a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:43:14.042175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-034d019a-1f94-479c-9e24-ab639d49eea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:14.095781 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1162/2314] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:43:20.117624 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b520ad-e527-4000-87cb-68011a3e29e0 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:20.118155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b520ad-e527-4000-87cb-68011a3e29e0 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:20.118258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b520ad-e527-4000-87cb-68011a3e29e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:20.142839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-89b520ad-e527-4000-87cb-68011a3e29e0 None None] MFA Rules not processed for user `945ab009e1024a199a324e9c4941e8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:43:20.144297 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-89b520ad-e527-4000-87cb-68011a3e29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:20.205454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1153/2315] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:43:30.545366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a8ac-c275-4900-9c65-3c2947e7b3da None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:30.545953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a8ac-c275-4900-9c65-3c2947e7b3da None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:30.545953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39a8ac-c275-4900-9c65-3c2947e7b3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:30.564776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-1e39a8ac-c275-4900-9c65-3c2947e7b3da None None] MFA Rules not processed for user `0557cb45047b49818d049d5b1bb7f49f`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:43:30.566001 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1e39a8ac-c275-4900-9c65-3c2947e7b3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:30.633602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1163/2316] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:43:33.066579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ebf0c-7837-4b6a-8fb0-75ad6a818f99 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:33.067096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ebf0c-7837-4b6a-8fb0-75ad6a818f99 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:33.067392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ebf0c-7837-4b6a-8fb0-75ad6a818f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:33.088093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6b2ebf0c-7837-4b6a-8fb0-75ad6a818f99 None None] MFA Rules not processed for user `50998395da9a417eaa555e714c998496`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:43:33.091152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6b2ebf0c-7837-4b6a-8fb0-75ad6a818f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:33.096905 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1154/2317] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:43:42.035938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380557d-4ea9-4535-8bb8-aa4f3d8c3f9d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:42.042210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380557d-4ea9-4535-8bb8-aa4f3d8c3f9d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:42.042210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380557d-4ea9-4535-8bb8-aa4f3d8c3f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:42.057795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8380557d-4ea9-4535-8bb8-aa4f3d8c3f9d None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:43:42.062343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8380557d-4ea9-4535-8bb8-aa4f3d8c3f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:42.066930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1164/2318] 10.222.0.43 () {58 vars in 967 bytes} [Thu Apr 28 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:43:42.210853 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ebf0c-7837-4b6a-8fb0-75ad6a818f99 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:43:42.222340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ebf0c-7837-4b6a-8fb0-75ad6a818f99 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:43:42.227819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cc41c-1f87-4217-8b84-cddf60f7649b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:43:42.228389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc41c-1f87-4217-8b84-cddf60f7649b service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:42.228677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc41c-1f87-4217-8b84-cddf60f7649b service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:42.228956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cc41c-1f87-4217-8b84-cddf60f7649b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:42.240403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cc41c-1f87-4217-8b84-cddf60f7649b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:43:42.242020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cc41c-1f87-4217-8b84-cddf60f7649b service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:43:42.252602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1155/2319] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:43:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:43:45.335550 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380557d-4ea9-4535-8bb8-aa4f3d8c3f9d None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:43:45.346393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380557d-4ea9-4535-8bb8-aa4f3d8c3f9d None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:43:45.350444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:43:45.351262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:45.351555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:45.351835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:45.353698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:45.368501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:43:45.370114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:43:45.383343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1165/2320] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:43:46.656595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cc41c-1f87-4217-8b84-cddf60f7649b service swift] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:43:46.671970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cc41c-1f87-4217-8b84-cddf60f7649b service swift] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:43:46.676750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:43:46.677885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:46.678353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:46.678883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:46.683010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:46.711939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:43:46.715830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:43:46.738506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1156/2321] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:43:51.438205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:43:51.439804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:51.529000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e6658-021c-407e-8ff5-e189049e1f24 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:43:51.536658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:43:51.537514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:51.537797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:51.538071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] PATH_INFO: `/v3/users/82bcd0d11bc346858946b46d4b65c047` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:51.539302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82bcd0d11bc346858946b46d4b65c047)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:43:51.541428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:43:51.706985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82bcd0d11bc346858946b46d4b65c047'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:51.716971 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82bcd0d11bc346858946b46d4b65c047'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:51.718144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82bcd0d11bc346858946b46d4b65c047'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:51.718944 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82bcd0d11bc346858946b46d4b65c047'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:51.785712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82bcd0d11bc346858946b46d4b65c047'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:51.821162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1166/2322] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:43:51 2022] DELETE /identity/v3/users/82bcd0d11bc346858946b46d4b65c047 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:43:52.088809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:43:52.120972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e8be0-f845-42b7-8a79-58fbf0b6f1af service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:43:52.179189 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:43:52.180053 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:52.180337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:52.180615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] PATH_INFO: `/v3/projects/21293c6d668a443199fad85681f13cf5` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:52.181798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21293c6d668a443199fad85681f13cf5)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:43:52.183763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:43:52.312663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21293c6d668a443199fad85681f13cf5', 'request_id': 'req-379c8ab1-110d-4f4e-91e1-e30430ef5c33'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.378634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21293c6d668a443199fad85681f13cf5', 'request_id': 'req-379c8ab1-110d-4f4e-91e1-e30430ef5c33'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.384869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21293c6d668a443199fad85681f13cf5', 'request_id': 'req-379c8ab1-110d-4f4e-91e1-e30430ef5c33'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.396706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] The token cache is being invalidate because project 21293c6d668a443199fad85681f13cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:43:52.397076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.397801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.399644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1157/2323] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:43:52 2022] DELETE /identity/v3/projects/21293c6d668a443199fad85681f13cf5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:43:52.403440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:43:52.405108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:52.417880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bade023-28d5-4927-8f45-de83e7d47494 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:43:52.475485 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:43:52.476367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:52.476650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:52.476928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] PATH_INFO: `/v3/users/6832141a987446d8920935fc9c1603b5` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:52.478117 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6832141a987446d8920935fc9c1603b5)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:43:52.480084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:43:52.632044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6832141a987446d8920935fc9c1603b5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.639314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6832141a987446d8920935fc9c1603b5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.639994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6832141a987446d8920935fc9c1603b5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.640600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6832141a987446d8920935fc9c1603b5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.686894 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6832141a987446d8920935fc9c1603b5'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:52.704729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1167/2324] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:43:52 2022] DELETE /identity/v3/users/6832141a987446d8920935fc9c1603b5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:43:52.940424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:43:52.942023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:43:52.956861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c8ab1-110d-4f4e-91e1-e30430ef5c33 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:43:53.021461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:43:53.022483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:43:53.022928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:43:53.023224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] PATH_INFO: `/v3/projects/792ca67aa4994535be22a71167ecd681` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:43:53.024427 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=792ca67aa4994535be22a71167ecd681)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:43:53.028765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:43:53.147599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792ca67aa4994535be22a71167ecd681', 'request_id': 'req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:53.207324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792ca67aa4994535be22a71167ecd681', 'request_id': 'req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:53.213299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792ca67aa4994535be22a71167ecd681', 'request_id': 'req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:53.226707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] The token cache is being invalidate because project 792ca67aa4994535be22a71167ecd681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:43:53.227001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:53.227807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:43:53.229363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1158/2325] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:43:52 2022] DELETE /identity/v3/projects/792ca67aa4994535be22a71167ecd681 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:44:01.816773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:01.818181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:01.889107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dda67-62cd-4148-9267-a4004e2947b2 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:01.959575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:01.960461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:01.960659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:01.961002 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:01.963277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:02.026799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:02.028427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:02.038259 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1168/2326] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:06.513742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:06.515193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:06.572341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d6e79-63b8-4506-a9b9-4fd214f51f0d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:06.576007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:06.576652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:06.576939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:06.577218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:06.579145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:06.588436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:06.590284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:06.598521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1159/2327] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:07.539432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:07.540794 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:07.554548 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db74ce6-88c5-42ea-a0a2-f2ccdd3c8ec7 service nova] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:07.560844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:07.561556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:07.561917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:07.562272 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:07.564144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:07.577131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:07.578733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:07.589759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1169/2328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:10.584400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:10.592894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ac043-615d-4bb8-af50-6562babdcaf1 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:10.597167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:10.597797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:10.598079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:10.598360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:10.600233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:10.609920 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:10.611507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:10.619769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1160/2329] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:10.988227 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:10.989709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:11.075108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea9b77-8db7-431a-9178-3e340df67118 service nova] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:11.080252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded012db549b45669a4ffcdd988b55ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:11.080903 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:11.081190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:11.081466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:11.083351 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:11.095056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:11.096651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:11.106596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1170/2330] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:21.636622 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:21.650686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7dd9d-3463-4e39-96cc-84ab0ca11f22 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:21.656509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:21.657156 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:21.659747 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:21.659747 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:21.660335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:21.717082 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:21.718721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:21.728405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1161/2331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:25.045989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:25.056500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdd437-5201-471a-a3ad-d0e93b354bfb service placement] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:25.060067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:25.060717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:25.061031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:25.061310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:25.063150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:25.126439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:25.127921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:25.138163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1171/2332] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:27.621752 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:27.624168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:27.640588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a98eb-7181-426d-ae0c-7613734b8dbb service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:27.647809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:27.648775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:27.649273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:27.649733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:27.651764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:27.665811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:27.667974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:27.679418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1162/2333] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:29.203022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:29.205045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:29.217646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09db642-2f89-4c60-97d3-5ed64f267f64 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:29.222734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:29.223597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:29.223882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:29.224159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] PATH_INFO: `/v3/users/788335ddb63f4b458dd3e5b38ea3a79a` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:29.225336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=788335ddb63f4b458dd3e5b38ea3a79a)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:29.227409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:29.344439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788335ddb63f4b458dd3e5b38ea3a79a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.352061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788335ddb63f4b458dd3e5b38ea3a79a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.352736 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788335ddb63f4b458dd3e5b38ea3a79a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.353342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788335ddb63f4b458dd3e5b38ea3a79a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.388410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-02b9d5cb-dcba-45ca-b50e-5ce4bd81d8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788335ddb63f4b458dd3e5b38ea3a79a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.405916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1172/2334] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:44:29 2022] DELETE /identity/v3/users/788335ddb63f4b458dd3e5b38ea3a79a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:44:29.662376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:29.685068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9afb1-82a6-411a-9e34-4e1b9b43c5c7 service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:29.743651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:29.744508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:29.744810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:29.745067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] PATH_INFO: `/v3/projects/0cda26128b0441359a1a609c68e2497c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:29.746395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cda26128b0441359a1a609c68e2497c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:29.748328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:29.863068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cda26128b0441359a1a609c68e2497c', 'request_id': 'req-2934c5f4-a84f-4500-b0c9-a103fb97387f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.908846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cda26128b0441359a1a609c68e2497c', 'request_id': 'req-2934c5f4-a84f-4500-b0c9-a103fb97387f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.914296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cda26128b0441359a1a609c68e2497c', 'request_id': 'req-2934c5f4-a84f-4500-b0c9-a103fb97387f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.925458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] The token cache is being invalidate because project 0cda26128b0441359a1a609c68e2497c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:44:29.925748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.926404 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2934c5f4-a84f-4500-b0c9-a103fb97387f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:44:29.927995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1163/2335] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:44:29 2022] DELETE /identity/v3/projects/0cda26128b0441359a1a609c68e2497c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:44:29.932965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa972-be8c-4e95-98ff-f7334eaa2b01 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:29.937270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa972-be8c-4e95-98ff-f7334eaa2b01 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:29.937270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa972-be8c-4e95-98ff-f7334eaa2b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:29.955809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d31fa972-be8c-4e95-98ff-f7334eaa2b01 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:44:29.957510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d31fa972-be8c-4e95-98ff-f7334eaa2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:30.018669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1173/2336] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:44:30.026317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa7c09-df73-401e-af5b-cff80f3e6184 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.026646 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa7c09-df73-401e-af5b-cff80f3e6184 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.026929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa7c09-df73-401e-af5b-cff80f3e6184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.046817 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-81aa7c09-df73-401e-af5b-cff80f3e6184 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:44:30.048564 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-81aa7c09-df73-401e-af5b-cff80f3e6184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:30.056641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1164/2337] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:44:30.060840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa972-be8c-4e95-98ff-f7334eaa2b01 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.071547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa972-be8c-4e95-98ff-f7334eaa2b01 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.076100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.076744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.077026 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.077302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.078022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:44:30.078328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.080097 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.091266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1174/2338] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:44:30.096142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa7c09-df73-401e-af5b-cff80f3e6184 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.105635 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa7c09-df73-401e-af5b-cff80f3e6184 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.110388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65ad2-ab7d-40ec-8450-fdd67978f5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.111723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65ad2-ab7d-40ec-8450-fdd67978f5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.112008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65ad2-ab7d-40ec-8450-fdd67978f5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.114897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65ad2-ab7d-40ec-8450-fdd67978f5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.114897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd65ad2-ab7d-40ec-8450-fdd67978f5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.115093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd65ad2-ab7d-40ec-8450-fdd67978f5e6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.193732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1165/2339] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:44:30 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:44:30.194970 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.205153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c77e20-b384-4612-9024-2bb96e6fa316 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.262330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dc955-e93c-4ba9-bd4e-8b4e65210fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.263083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc955-e93c-4ba9-bd4e-8b4e65210fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.263374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc955-e93c-4ba9-bd4e-8b4e65210fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.263654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dc955-e93c-4ba9-bd4e-8b4e65210fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.264537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dc955-e93c-4ba9-bd4e-8b4e65210fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.266617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dc955-e93c-4ba9-bd4e-8b4e65210fd0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.338124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1175/2340] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:44:30 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:44:30.342225 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65ad2-ab7d-40ec-8450-fdd67978f5e6 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.353878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65ad2-ab7d-40ec-8450-fdd67978f5e6 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.361363 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734edd3a-3bdd-4f0a-aca2-321fff332ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.362109 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edd3a-3bdd-4f0a-aca2-321fff332ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.362470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edd3a-3bdd-4f0a-aca2-321fff332ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.362862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edd3a-3bdd-4f0a-aca2-321fff332ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.363690 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734edd3a-3bdd-4f0a-aca2-321fff332ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.365419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734edd3a-3bdd-4f0a-aca2-321fff332ba1 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.375812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1166/2341] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:44:30.379852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dc955-e93c-4ba9-bd4e-8b4e65210fd0 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.390279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dc955-e93c-4ba9-bd4e-8b4e65210fd0 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.394968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccde27-8818-4a3a-9128-ff735915123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.395613 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccde27-8818-4a3a-9128-ff735915123e admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.395897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccde27-8818-4a3a-9128-ff735915123e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.396173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccde27-8818-4a3a-9128-ff735915123e admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.396897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccde27-8818-4a3a-9128-ff735915123e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.398483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccde27-8818-4a3a-9128-ff735915123e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.409068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1176/2342] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:44:30.413034 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734edd3a-3bdd-4f0a-aca2-321fff332ba1 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.423730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734edd3a-3bdd-4f0a-aca2-321fff332ba1 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.428522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc7972-157b-4ab3-a1fd-c49998428c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.429425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc7972-157b-4ab3-a1fd-c49998428c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.429713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc7972-157b-4ab3-a1fd-c49998428c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.429992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc7972-157b-4ab3-a1fd-c49998428c2b admin admin] PATH_INFO: `/v3/projects/cfa712f232554e52b937b91c6c41f4f1/users/2839b5c4115a44758d4747c75fd770f8/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.444086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc7972-157b-4ab3-a1fd-c49998428c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa712f232554e52b937b91c6c41f4f1, user_id=2839b5c4115a44758d4747c75fd770f8, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.446788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc7972-157b-4ab3-a1fd-c49998428c2b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.543386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1167/2343] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:44:30 2022] PUT /identity/v3/projects/cfa712f232554e52b937b91c6c41f4f1/users/2839b5c4115a44758d4747c75fd770f8/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:44:30.553557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137f51-43f3-47b0-bfac-79833ba3df42 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.553856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137f51-43f3-47b0-bfac-79833ba3df42 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.554158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137f51-43f3-47b0-bfac-79833ba3df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.579993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-70137f51-43f3-47b0-bfac-79833ba3df42 None None] MFA Rules not processed for user `2839b5c4115a44758d4747c75fd770f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:44:30.581200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-70137f51-43f3-47b0-bfac-79833ba3df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:30.655480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1177/2344] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:44:30.660694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc7972-157b-4ab3-a1fd-c49998428c2b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.720689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc7972-157b-4ab3-a1fd-c49998428c2b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.725453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de754-9b2a-403e-9d3f-c184736af6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.726121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de754-9b2a-403e-9d3f-c184736af6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.726407 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de754-9b2a-403e-9d3f-c184736af6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.726724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de754-9b2a-403e-9d3f-c184736af6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.727469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2de754-9b2a-403e-9d3f-c184736af6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.729378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2de754-9b2a-403e-9d3f-c184736af6cb admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.813839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1168/2345] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:44:30 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:44:30.817783 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70137f51-43f3-47b0-bfac-79833ba3df42 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.829012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70137f51-43f3-47b0-bfac-79833ba3df42 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.883978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad039d-4852-4647-8dd2-e26385ad929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.884646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad039d-4852-4647-8dd2-e26385ad929d admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.884931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad039d-4852-4647-8dd2-e26385ad929d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.885207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad039d-4852-4647-8dd2-e26385ad929d admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.885896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad039d-4852-4647-8dd2-e26385ad929d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.887847 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad039d-4852-4647-8dd2-e26385ad929d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.954030 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1178/2346] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:44:30 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:44:30.958482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de754-9b2a-403e-9d3f-c184736af6cb admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:30.968674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de754-9b2a-403e-9d3f-c184736af6cb admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:30.973338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8722da4-efd5-435e-bd81-60a9118df713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:30.973992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722da4-efd5-435e-bd81-60a9118df713 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:30.974280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722da4-efd5-435e-bd81-60a9118df713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:30.974592 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722da4-efd5-435e-bd81-60a9118df713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:30.975323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8722da4-efd5-435e-bd81-60a9118df713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:30.976920 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8722da4-efd5-435e-bd81-60a9118df713 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:30.987109 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1169/2347] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:44:30.991318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad039d-4852-4647-8dd2-e26385ad929d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:31.001636 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad039d-4852-4647-8dd2-e26385ad929d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:31.006379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80fafa-f3f8-4098-97f3-f775cb979739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:31.007285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80fafa-f3f8-4098-97f3-f775cb979739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:31.007576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80fafa-f3f8-4098-97f3-f775cb979739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:31.007851 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80fafa-f3f8-4098-97f3-f775cb979739 admin admin] PATH_INFO: `/v3/projects/37c6683bc0ff47298df1ef63ed35becb/users/2a924313edc246fe84ab93b0e1dd051b/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:31.022464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80fafa-f3f8-4098-97f3-f775cb979739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c6683bc0ff47298df1ef63ed35becb, user_id=2a924313edc246fe84ab93b0e1dd051b, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:31.025153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80fafa-f3f8-4098-97f3-f775cb979739 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:31.091252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1179/2348] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:44:30 2022] PUT /identity/v3/projects/37c6683bc0ff47298df1ef63ed35becb/users/2a924313edc246fe84ab93b0e1dd051b/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:44:31.095296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8722da4-efd5-435e-bd81-60a9118df713 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:31.105173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8722da4-efd5-435e-bd81-60a9118df713 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:31.158819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd5b97-0498-4256-8519-270d2e679687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:31.159481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5b97-0498-4256-8519-270d2e679687 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:31.159770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5b97-0498-4256-8519-270d2e679687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:31.160050 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5b97-0498-4256-8519-270d2e679687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:31.160776 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd5b97-0498-4256-8519-270d2e679687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:31.162364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd5b97-0498-4256-8519-270d2e679687 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:31.171719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1170/2349] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:44:31.175807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80fafa-f3f8-4098-97f3-f775cb979739 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:31.185821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80fafa-f3f8-4098-97f3-f775cb979739 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:31.190951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:31.191812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:31.192093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:31.192364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] PATH_INFO: `/v3/projects/37c6683bc0ff47298df1ef63ed35becb/users/2a924313edc246fe84ab93b0e1dd051b/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:31.194345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c6683bc0ff47298df1ef63ed35becb, user_id=2a924313edc246fe84ab93b0e1dd051b, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:31.197182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:31.207696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1180/2350] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:44:31 2022] PUT /identity/v3/projects/37c6683bc0ff47298df1ef63ed35becb/users/2a924313edc246fe84ab93b0e1dd051b/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:44:31.218909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929762d-3dbc-4eb9-bca5-bc1f662b987b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:31.219205 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929762d-3dbc-4eb9-bca5-bc1f662b987b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:31.219487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929762d-3dbc-4eb9-bca5-bc1f662b987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:31.245015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-a929762d-3dbc-4eb9-bca5-bc1f662b987b None None] MFA Rules not processed for user `2a924313edc246fe84ab93b0e1dd051b`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:44:31.246347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a929762d-3dbc-4eb9-bca5-bc1f662b987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:31.310785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1171/2351] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:44:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:44:31.321969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:31.323686 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:31.379519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8560d-b52a-42f9-bbc4-332dcfeab702 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:31.383252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358327f8-b02f-48f1-b394-cc2094649ca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:31.383891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358327f8-b02f-48f1-b394-cc2094649ca8 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:31.384232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358327f8-b02f-48f1-b394-cc2094649ca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:31.384632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358327f8-b02f-48f1-b394-cc2094649ca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:31.441361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358327f8-b02f-48f1-b394-cc2094649ca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:31.442836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358327f8-b02f-48f1-b394-cc2094649ca8 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:31.451483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1181/2352] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:35.399281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929762d-3dbc-4eb9-bca5-bc1f662b987b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:35.400787 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a929762d-3dbc-4eb9-bca5-bc1f662b987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:35.475632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929762d-3dbc-4eb9-bca5-bc1f662b987b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:35.481061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e116-a294-41f8-ac2a-b45eae70b920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:35.481712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e116-a294-41f8-ac2a-b45eae70b920 service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:35.481995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e116-a294-41f8-ac2a-b45eae70b920 service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:35.482272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e116-a294-41f8-ac2a-b45eae70b920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:35.484104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-21e4e116-a294-41f8-ac2a-b45eae70b920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:35.542749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4e116-a294-41f8-ac2a-b45eae70b920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:35.544276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4e116-a294-41f8-ac2a-b45eae70b920 service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:35.553149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1172/2353] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:37.492943 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358327f8-b02f-48f1-b394-cc2094649ca8 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:37.502271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358327f8-b02f-48f1-b394-cc2094649ca8 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:37.508297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cc779-e3e5-4c8f-ad2e-82009ba83d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:37.508417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc779-e3e5-4c8f-ad2e-82009ba83d2f service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:37.508695 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc779-e3e5-4c8f-ad2e-82009ba83d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:37.508987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc779-e3e5-4c8f-ad2e-82009ba83d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:37.519148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cc779-e3e5-4c8f-ad2e-82009ba83d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:37.523101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cc779-e3e5-4c8f-ad2e-82009ba83d2f service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:37.530422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1182/2354] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:44:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:44:49.271131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68368df9-e58a-4e80-9b80-e1d2b6842807 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:49.271629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68368df9-e58a-4e80-9b80-e1d2b6842807 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:49.271723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68368df9-e58a-4e80-9b80-e1d2b6842807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:49.288612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-68368df9-e58a-4e80-9b80-e1d2b6842807 None None] MFA Rules not processed for user `3b3b7cf50b844d94948110080a7eaed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:44:49.289831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-68368df9-e58a-4e80-9b80-e1d2b6842807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:49.341962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1173/2355] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:44:50.802814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab0734-22ed-40de-aa9d-1ff5e34b7fff None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:50.803355 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab0734-22ed-40de-aa9d-1ff5e34b7fff None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:50.803458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab0734-22ed-40de-aa9d-1ff5e34b7fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:50.823455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-50ab0734-22ed-40de-aa9d-1ff5e34b7fff None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:44:50.824670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-50ab0734-22ed-40de-aa9d-1ff5e34b7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:50.887094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1183/2356] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:44:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:44:51.044660 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68368df9-e58a-4e80-9b80-e1d2b6842807 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:44:51.046096 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-68368df9-e58a-4e80-9b80-e1d2b6842807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:44:51.116676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68368df9-e58a-4e80-9b80-e1d2b6842807 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:44:51.121797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c3490-ee99-4cd4-8760-f92bb09b9af5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:44:51.122483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c3490-ee99-4cd4-8760-f92bb09b9af5 service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:44:51.122895 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c3490-ee99-4cd4-8760-f92bb09b9af5 service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:44:51.124185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c3490-ee99-4cd4-8760-f92bb09b9af5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:44:51.131768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c3490-ee99-4cd4-8760-f92bb09b9af5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:44:51.133380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c3490-ee99-4cd4-8760-f92bb09b9af5 service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:44:51.141439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1174/2357] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:44:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:45:03.166220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab0734-22ed-40de-aa9d-1ff5e34b7fff None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:03.167813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-50ab0734-22ed-40de-aa9d-1ff5e34b7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:03.185328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab0734-22ed-40de-aa9d-1ff5e34b7fff None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:03.195300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002288f-41fb-4c80-8880-8bb3a04276c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:03.196041 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002288f-41fb-4c80-8880-8bb3a04276c2 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:03.196395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002288f-41fb-4c80-8880-8bb3a04276c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:03.196740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002288f-41fb-4c80-8880-8bb3a04276c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:03.198702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c002288f-41fb-4c80-8880-8bb3a04276c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:03.225748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002288f-41fb-4c80-8880-8bb3a04276c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:03.225748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002288f-41fb-4c80-8880-8bb3a04276c2 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:03.245495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1184/2358] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:05.569092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c3490-ee99-4cd4-8760-f92bb09b9af5 service swift] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:05.634457 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c3490-ee99-4cd4-8760-f92bb09b9af5 service swift] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:05.639013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:05.639900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:05.640194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:05.640473 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] PATH_INFO: `/v3/users/2839b5c4115a44758d4747c75fd770f8` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:05.641699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2839b5c4115a44758d4747c75fd770f8)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:05.643699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:05.827121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2839b5c4115a44758d4747c75fd770f8'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:05.827280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2839b5c4115a44758d4747c75fd770f8'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:05.834523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2839b5c4115a44758d4747c75fd770f8'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:05.835607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2839b5c4115a44758d4747c75fd770f8'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:05.931528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2839b5c4115a44758d4747c75fd770f8'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:05.951696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1175/2359] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:45:05 2022] DELETE /identity/v3/users/2839b5c4115a44758d4747c75fd770f8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:05.956222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3f37-0ef4-46c3-a1f9-61fed662048b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:05.957099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3f37-0ef4-46c3-a1f9-61fed662048b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:05.957385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3f37-0ef4-46c3-a1f9-61fed662048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:05.995667 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d3ad3f37-0ef4-46c3-a1f9-61fed662048b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:05.997084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d3ad3f37-0ef4-46c3-a1f9-61fed662048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:06.080129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1185/2360] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:45:06.090079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:06.092415 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:06.154399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15010854-2b3e-4cc6-9953-72a0d4b1d010 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:06.158418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2e199-f71a-4431-aeb7-e488e82ba7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:06.170689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e199-f71a-4431-aeb7-e488e82ba7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:06.170899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e199-f71a-4431-aeb7-e488e82ba7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:06.171188 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e199-f71a-4431-aeb7-e488e82ba7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:06.197649 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2e199-f71a-4431-aeb7-e488e82ba7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:06.200231 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2e199-f71a-4431-aeb7-e488e82ba7e7 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:06.215159 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1176/2361] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:06.696425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3f37-0ef4-46c3-a1f9-61fed662048b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:06.697934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d3ad3f37-0ef4-46c3-a1f9-61fed662048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:06.710294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3f37-0ef4-46c3-a1f9-61fed662048b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:06.715251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:06.716411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:06.716638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:06.716941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] PATH_INFO: `/v3/projects/cfa712f232554e52b937b91c6c41f4f1` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:06.718566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa712f232554e52b937b91c6c41f4f1)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:06.720234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:06.836640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa712f232554e52b937b91c6c41f4f1', 'request_id': 'req-ea4d127d-cfaf-4f68-9101-492365d48072'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:06.885245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa712f232554e52b937b91c6c41f4f1', 'request_id': 'req-ea4d127d-cfaf-4f68-9101-492365d48072'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:06.891430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa712f232554e52b937b91c6c41f4f1', 'request_id': 'req-ea4d127d-cfaf-4f68-9101-492365d48072'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:06.903194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] The token cache is being invalidate because project cfa712f232554e52b937b91c6c41f4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:45:06.903738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:06.904389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:06.905980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1186/2362] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:45:06 2022] DELETE /identity/v3/projects/cfa712f232554e52b937b91c6c41f4f1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:06.909861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2e199-f71a-4431-aeb7-e488e82ba7e7 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:06.919948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2e199-f71a-4431-aeb7-e488e82ba7e7 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:06.976031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:06.976831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:06.977116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:06.977395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] PATH_INFO: `/v3/users/2a924313edc246fe84ab93b0e1dd051b` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:06.978611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a924313edc246fe84ab93b0e1dd051b)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:06.980536 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:07.178859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a924313edc246fe84ab93b0e1dd051b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:07.179866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a924313edc246fe84ab93b0e1dd051b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:07.186876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a924313edc246fe84ab93b0e1dd051b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:07.187545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a924313edc246fe84ab93b0e1dd051b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:07.273854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a4b6a7bf-c8f9-48b0-a4fc-bcad3d3ac683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a924313edc246fe84ab93b0e1dd051b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:07.293160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1177/2363] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:45:06 2022] DELETE /identity/v3/users/2a924313edc246fe84ab93b0e1dd051b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:45:07.888606 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:07.891109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:07.907628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d127d-cfaf-4f68-9101-492365d48072 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:07.968196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:07.969068 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:07.969349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:07.969719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] PATH_INFO: `/v3/projects/37c6683bc0ff47298df1ef63ed35becb` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:07.970965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c6683bc0ff47298df1ef63ed35becb)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:07.972912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:08.092697 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c6683bc0ff47298df1ef63ed35becb', 'request_id': 'req-a68169d1-19e7-404c-9f1b-dff39f80bd5b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:08.194786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c6683bc0ff47298df1ef63ed35becb', 'request_id': 'req-a68169d1-19e7-404c-9f1b-dff39f80bd5b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:08.200373 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c6683bc0ff47298df1ef63ed35becb', 'request_id': 'req-a68169d1-19e7-404c-9f1b-dff39f80bd5b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:08.211673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] The token cache is being invalidate because project 37c6683bc0ff47298df1ef63ed35becb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:45:08.211962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:08.212594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a68169d1-19e7-404c-9f1b-dff39f80bd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:08.214135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1187/2364] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:45:07 2022] DELETE /identity/v3/projects/37c6683bc0ff47298df1ef63ed35becb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:08.219101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816a15-fff1-41d4-85eb-e1263d9b2e5b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.219563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816a15-fff1-41d4-85eb-e1263d9b2e5b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.219808 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816a15-fff1-41d4-85eb-e1263d9b2e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.237757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-d7816a15-fff1-41d4-85eb-e1263d9b2e5b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:08.239003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d7816a15-fff1-41d4-85eb-e1263d9b2e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:08.296950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1178/2365] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:08.305351 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502d2eb-3d58-40b2-9db0-874859f86d0e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.305656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502d2eb-3d58-40b2-9db0-874859f86d0e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.307254 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502d2eb-3d58-40b2-9db0-874859f86d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.331699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-6502d2eb-3d58-40b2-9db0-874859f86d0e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:08.332962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6502d2eb-3d58-40b2-9db0-874859f86d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:08.343216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1188/2366] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:08.347615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7816a15-fff1-41d4-85eb-e1263d9b2e5b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:08.357953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7816a15-fff1-41d4-85eb-e1263d9b2e5b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:08.362980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:08.363664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.363970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.364912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.365650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:45:08.365955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:08.367687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:08.393030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1179/2367] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:45:08.397515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502d2eb-3d58-40b2-9db0-874859f86d0e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:08.416384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502d2eb-3d58-40b2-9db0-874859f86d0e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:08.421358 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6191f5e-c94f-46a5-98d4-bbf460e2557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:08.422027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6191f5e-c94f-46a5-98d4-bbf460e2557a admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.422317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6191f5e-c94f-46a5-98d4-bbf460e2557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.422632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6191f5e-c94f-46a5-98d4-bbf460e2557a admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.423326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6191f5e-c94f-46a5-98d4-bbf460e2557a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:08.425241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6191f5e-c94f-46a5-98d4-bbf460e2557a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:08.542612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1189/2368] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:45:08 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:08.543616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:08.554448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2c8da-2fe1-4a29-bf68-5736833209e6 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:08.624226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548e236-8cc9-41d5-87fe-53addceb968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:08.625142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e236-8cc9-41d5-87fe-53addceb968b admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.625428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e236-8cc9-41d5-87fe-53addceb968b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.626762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e236-8cc9-41d5-87fe-53addceb968b admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.627509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548e236-8cc9-41d5-87fe-53addceb968b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:08.629602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548e236-8cc9-41d5-87fe-53addceb968b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:08.702648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1180/2369] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:45:08 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:08.708673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6191f5e-c94f-46a5-98d4-bbf460e2557a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:08.717947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6191f5e-c94f-46a5-98d4-bbf460e2557a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:08.725458 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d66c-fc23-4dd6-85eb-0ef4a247b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:08.726135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d66c-fc23-4dd6-85eb-0ef4a247b121 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.726451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d66c-fc23-4dd6-85eb-0ef4a247b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.730307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d66c-fc23-4dd6-85eb-0ef4a247b121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.730307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250d66c-fc23-4dd6-85eb-0ef4a247b121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:08.730307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250d66c-fc23-4dd6-85eb-0ef4a247b121 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:08.739479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd003-f409-45e4-9a50-2e1a1005e5ae None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.739774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd003-f409-45e4-9a50-2e1a1005e5ae None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.740057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd003-f409-45e4-9a50-2e1a1005e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.743082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1190/2370] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:08.744040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d66c-fc23-4dd6-85eb-0ef4a247b121 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:08.754212 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d66c-fc23-4dd6-85eb-0ef4a247b121 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:08.757892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-922fd003-f409-45e4-9a50-2e1a1005e5ae None None] MFA Rules not processed for user `50998395da9a417eaa555e714c998496`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:08.759236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-922fd003-f409-45e4-9a50-2e1a1005e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:08.759961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b959-a10d-496f-b5bc-b3a813b2e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:08.760870 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b959-a10d-496f-b5bc-b3a813b2e90f admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.761599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b959-a10d-496f-b5bc-b3a813b2e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.762370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b959-a10d-496f-b5bc-b3a813b2e90f admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.763449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b959-a10d-496f-b5bc-b3a813b2e90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:08.765541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b959-a10d-496f-b5bc-b3a813b2e90f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:08.781743 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1191/2371] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:08.782740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b959-a10d-496f-b5bc-b3a813b2e90f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:08.794500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b959-a10d-496f-b5bc-b3a813b2e90f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:08.800161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:08.801060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.801384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.801662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] PATH_INFO: `/v3/projects/7f28dbce9a974e0c874921bc3acfe000/users/05521401c3ed41eca04c0f1b5187feee/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.817890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f28dbce9a974e0c874921bc3acfe000, user_id=05521401c3ed41eca04c0f1b5187feee, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:08.820544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:08.828173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1181/2372] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:45:08.875045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1192/2373] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:08 2022] PUT /identity/v3/projects/7f28dbce9a974e0c874921bc3acfe000/users/05521401c3ed41eca04c0f1b5187feee/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:08.887147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7736d3-6cd6-416e-8d55-0639c12ea6e1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:08.887435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7736d3-6cd6-416e-8d55-0639c12ea6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:08.887754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7736d3-6cd6-416e-8d55-0639c12ea6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:08.920264 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-be7736d3-6cd6-416e-8d55-0639c12ea6e1 None None] MFA Rules not processed for user `05521401c3ed41eca04c0f1b5187feee`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:08.921525 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-be7736d3-6cd6-416e-8d55-0639c12ea6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:08.947671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:08.949530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:09.003296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1182/2374] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:45:09.008304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7736d3-6cd6-416e-8d55-0639c12ea6e1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:09.030845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727fa5e-f0ce-4afc-8c35-81ef6ca9a65c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:09.036779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:09.037377 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.037664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.037946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.039754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:09.075377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7736d3-6cd6-416e-8d55-0639c12ea6e1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:09.080505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574dbf8-a613-45a2-b52d-894fe9be8359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:09.085280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574dbf8-a613-45a2-b52d-894fe9be8359 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.085280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574dbf8-a613-45a2-b52d-894fe9be8359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.085280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574dbf8-a613-45a2-b52d-894fe9be8359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.085280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574dbf8-a613-45a2-b52d-894fe9be8359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:09.085280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574dbf8-a613-45a2-b52d-894fe9be8359 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:09.108175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:09.109778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:09.119256 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1193/2375] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:45:09.176306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1183/2376] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:45:09 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:45:09.177504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:09.188676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce817856-c3f2-4be9-8dff-6153aa961aef service nova] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:09.247003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a69a11-1947-4604-a571-b06eee3aa968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:09.247678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a69a11-1947-4604-a571-b06eee3aa968 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.247960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a69a11-1947-4604-a571-b06eee3aa968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.248234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a69a11-1947-4604-a571-b06eee3aa968 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.248926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a69a11-1947-4604-a571-b06eee3aa968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:09.251677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a69a11-1947-4604-a571-b06eee3aa968 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:09.352539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1194/2377] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:45:09 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:09.353819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574dbf8-a613-45a2-b52d-894fe9be8359 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:09.366183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574dbf8-a613-45a2-b52d-894fe9be8359 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:09.371475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61010fee-f20e-4634-a79c-ac57424a3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:09.372353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61010fee-f20e-4634-a79c-ac57424a3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.372812 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61010fee-f20e-4634-a79c-ac57424a3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.373092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61010fee-f20e-4634-a79c-ac57424a3f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.373845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61010fee-f20e-4634-a79c-ac57424a3f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:09.375562 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61010fee-f20e-4634-a79c-ac57424a3f92 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:09.388728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1184/2378] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:09.393307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a69a11-1947-4604-a571-b06eee3aa968 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:09.404255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a69a11-1947-4604-a571-b06eee3aa968 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:09.408969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8b864-dbda-4ee3-967b-687465d686af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:09.413709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8b864-dbda-4ee3-967b-687465d686af admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.413709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8b864-dbda-4ee3-967b-687465d686af admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.413709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8b864-dbda-4ee3-967b-687465d686af admin admin] PATH_INFO: `/v3/projects/ff44793ad13f48cd92c2871fc2f80e58/users/b085216c6b8c48b4a06c0767e56692f0/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.425504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8b864-dbda-4ee3-967b-687465d686af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff44793ad13f48cd92c2871fc2f80e58, user_id=b085216c6b8c48b4a06c0767e56692f0, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:09.429082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8b864-dbda-4ee3-967b-687465d686af admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:09.531618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1195/2379] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:09 2022] PUT /identity/v3/projects/ff44793ad13f48cd92c2871fc2f80e58/users/b085216c6b8c48b4a06c0767e56692f0/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:09.535688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61010fee-f20e-4634-a79c-ac57424a3f92 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:09.546200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61010fee-f20e-4634-a79c-ac57424a3f92 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:09.619071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cf7d7-e0fb-414d-a65b-e3c8676f9766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:09.619755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf7d7-e0fb-414d-a65b-e3c8676f9766 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.620254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf7d7-e0fb-414d-a65b-e3c8676f9766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.620514 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf7d7-e0fb-414d-a65b-e3c8676f9766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.621314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cf7d7-e0fb-414d-a65b-e3c8676f9766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:09.623383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cf7d7-e0fb-414d-a65b-e3c8676f9766 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:09.645455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1185/2380] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:09.654933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8b864-dbda-4ee3-967b-687465d686af admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:09.670852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8b864-dbda-4ee3-967b-687465d686af admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:09.686435 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:09.687589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.687936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.690307 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] PATH_INFO: `/v3/projects/ff44793ad13f48cd92c2871fc2f80e58/users/b085216c6b8c48b4a06c0767e56692f0/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.693265 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff44793ad13f48cd92c2871fc2f80e58, user_id=b085216c6b8c48b4a06c0767e56692f0, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:09.696112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:09.716640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1196/2381] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:09 2022] PUT /identity/v3/projects/ff44793ad13f48cd92c2871fc2f80e58/users/b085216c6b8c48b4a06c0767e56692f0/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:09.727108 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69235-08e3-479f-a3b6-64c6dc32253f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.727403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69235-08e3-479f-a3b6-64c6dc32253f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.727681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c69235-08e3-479f-a3b6-64c6dc32253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.758518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-72c69235-08e3-479f-a3b6-64c6dc32253f None None] MFA Rules not processed for user `b085216c6b8c48b4a06c0767e56692f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:09.759780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-72c69235-08e3-479f-a3b6-64c6dc32253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:09.831125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1186/2382] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:09.842858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:09.845277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:09.906160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db907ab-1dcf-420d-973c-aa43c2a49da9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:09.911408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c8484-5217-4cc4-991c-29130c5b4d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:09.912252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c8484-5217-4cc4-991c-29130c5b4d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:09.912619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c8484-5217-4cc4-991c-29130c5b4d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:09.912888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c8484-5217-4cc4-991c-29130c5b4d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:09.923747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c8484-5217-4cc4-991c-29130c5b4d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:09.925225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c8484-5217-4cc4-991c-29130c5b4d5d service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:09.936430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1197/2383] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:10.053962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea51ff7-09e7-4b59-be7d-a45fc7c8b8ec None None] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:10.054607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea51ff7-09e7-4b59-be7d-a45fc7c8b8ec None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:10.055002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea51ff7-09e7-4b59-be7d-a45fc7c8b8ec None None] PATH_INFO: `/` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:10.056563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1187/2384] 10.222.0.43 () {54 vars in 921 bytes} [Thu Apr 28 16:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 28 16:45:10.065484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d35886-dfbc-49fd-9d3b-28f618e62f77 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:10.065484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d35886-dfbc-49fd-9d3b-28f618e62f77 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:10.065484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d35886-dfbc-49fd-9d3b-28f618e62f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:10.085291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f6d35886-dfbc-49fd-9d3b-28f618e62f77 None None] MFA Rules not processed for user `5b28dcc32b984429939b95e436b4d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:10.086804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f6d35886-dfbc-49fd-9d3b-28f618e62f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:10.141040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea51ff7-09e7-4b59-be7d-a45fc7c8b8ec None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:10.155559 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea51ff7-09e7-4b59-be7d-a45fc7c8b8ec None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:10.159367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9b8ce-5f36-40df-adee-e224abe6090d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:10.164046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b8ce-5f36-40df-adee-e224abe6090d service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:10.164046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b8ce-5f36-40df-adee-e224abe6090d service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:10.164046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b8ce-5f36-40df-adee-e224abe6090d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:10.172615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1198/2385] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Apr 28 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:10.183455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d35886-dfbc-49fd-9d3b-28f618e62f77 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:10.191601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f6d35886-dfbc-49fd-9d3b-28f618e62f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:10.221166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9b8ce-5f36-40df-adee-e224abe6090d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:10.222816 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9b8ce-5f36-40df-adee-e224abe6090d service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:10.235114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1188/2386] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:45:10.243962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d35886-dfbc-49fd-9d3b-28f618e62f77 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:10.248452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a7a2-4fcf-4a1c-92b3-df5c3f232678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:10.249893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a7a2-4fcf-4a1c-92b3-df5c3f232678 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:10.249893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a7a2-4fcf-4a1c-92b3-df5c3f232678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:10.249893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a7a2-4fcf-4a1c-92b3-df5c3f232678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:10.263036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44a7a2-4fcf-4a1c-92b3-df5c3f232678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:10.264496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44a7a2-4fcf-4a1c-92b3-df5c3f232678 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:10.278890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1199/2387] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:45:10.731640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9b8ce-5f36-40df-adee-e224abe6090d service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:10.806570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9b8ce-5f36-40df-adee-e224abe6090d service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:10.811661 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:10.812567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:10.812900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:10.813191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] PATH_INFO: `/v3/users/05521401c3ed41eca04c0f1b5187feee` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:10.819410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05521401c3ed41eca04c0f1b5187feee)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:10.821410 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:11.074783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05521401c3ed41eca04c0f1b5187feee'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:11.075480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05521401c3ed41eca04c0f1b5187feee'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:11.085171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05521401c3ed41eca04c0f1b5187feee'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:11.098594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05521401c3ed41eca04c0f1b5187feee'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:11.211142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05521401c3ed41eca04c0f1b5187feee'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:11.235486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1189/2388] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:45:10 2022] DELETE /identity/v3/users/05521401c3ed41eca04c0f1b5187feee => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:11.237465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b5e3-8a90-4ae5-a425-e3d24e01fd90 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:11.237957 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b5e3-8a90-4ae5-a425-e3d24e01fd90 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:11.238132 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b5e3-8a90-4ae5-a425-e3d24e01fd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:11.266700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-2b08b5e3-8a90-4ae5-a425-e3d24e01fd90 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:11.268433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2b08b5e3-8a90-4ae5-a425-e3d24e01fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:11.343434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1200/2389] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:11.354207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:11.355746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:11.415361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172664-5b9c-4f35-9643-a858693cce35 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:11.418923 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bf80b-e271-4cd2-9ce4-d17018243059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:11.419674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bf80b-e271-4cd2-9ce4-d17018243059 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:11.419963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bf80b-e271-4cd2-9ce4-d17018243059 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:11.420246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bf80b-e271-4cd2-9ce4-d17018243059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:11.431061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bf80b-e271-4cd2-9ce4-d17018243059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:11.432507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bf80b-e271-4cd2-9ce4-d17018243059 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:11.442192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1190/2390] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:45:11.824630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b5e3-8a90-4ae5-a425-e3d24e01fd90 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:11.826054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2b08b5e3-8a90-4ae5-a425-e3d24e01fd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:11.838585 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b5e3-8a90-4ae5-a425-e3d24e01fd90 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:11.843534 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:11.844649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:11.845134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:11.845613 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] PATH_INFO: `/v3/projects/7f28dbce9a974e0c874921bc3acfe000` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:11.847084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f28dbce9a974e0c874921bc3acfe000)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:11.849007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:11.980642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f28dbce9a974e0c874921bc3acfe000', 'request_id': 'req-16f0296a-4428-4c62-8493-d3790bc1f72b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.080129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f28dbce9a974e0c874921bc3acfe000', 'request_id': 'req-16f0296a-4428-4c62-8493-d3790bc1f72b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.086710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f28dbce9a974e0c874921bc3acfe000', 'request_id': 'req-16f0296a-4428-4c62-8493-d3790bc1f72b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.099690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] The token cache is being invalidate because project 7f28dbce9a974e0c874921bc3acfe000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:45:12.100588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.101305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.107324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1201/2391] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:45:11 2022] DELETE /identity/v3/projects/7f28dbce9a974e0c874921bc3acfe000 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:12.107851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bf80b-e271-4cd2-9ce4-d17018243059 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:12.117892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bf80b-e271-4cd2-9ce4-d17018243059 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:12.192373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:12.193270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:12.193560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:12.193842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] PATH_INFO: `/v3/users/b085216c6b8c48b4a06c0767e56692f0` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:12.195114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b085216c6b8c48b4a06c0767e56692f0)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:12.197068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:12.402675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b085216c6b8c48b4a06c0767e56692f0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.403711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b085216c6b8c48b4a06c0767e56692f0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.413818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b085216c6b8c48b4a06c0767e56692f0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.416965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b085216c6b8c48b4a06c0767e56692f0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.469093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d1568f0e-936f-4a42-920e-af1d9ccf1ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b085216c6b8c48b4a06c0767e56692f0'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:12.500029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1191/2392] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:45:12 2022] DELETE /identity/v3/users/b085216c6b8c48b4a06c0767e56692f0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:12.997283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:12.999366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:13.017626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0296a-4428-4c62-8493-d3790bc1f72b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:13.104473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:13.105546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:13.105896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:13.106241 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] PATH_INFO: `/v3/projects/ff44793ad13f48cd92c2871fc2f80e58` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:13.107623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff44793ad13f48cd92c2871fc2f80e58)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:13.110159 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:13.245062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff44793ad13f48cd92c2871fc2f80e58', 'request_id': 'req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:13.354131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff44793ad13f48cd92c2871fc2f80e58', 'request_id': 'req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:13.360661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff44793ad13f48cd92c2871fc2f80e58', 'request_id': 'req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:13.377812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] The token cache is being invalidate because project ff44793ad13f48cd92c2871fc2f80e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:45:13.378108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:13.378792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ec6eeb8c-e73d-4087-b034-1f273a6d33b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:13.380935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1202/2393] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:45:12 2022] DELETE /identity/v3/projects/ff44793ad13f48cd92c2871fc2f80e58 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:13.385851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77161bed-a3b3-4e68-8ba8-6a938fdffd20 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:13.386327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77161bed-a3b3-4e68-8ba8-6a938fdffd20 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:13.386420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77161bed-a3b3-4e68-8ba8-6a938fdffd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:13.404403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-77161bed-a3b3-4e68-8ba8-6a938fdffd20 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:13.405761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-77161bed-a3b3-4e68-8ba8-6a938fdffd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:13.444511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f4df-131b-42d7-a433-f1afd4b09f39 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:13.445058 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f4df-131b-42d7-a433-f1afd4b09f39 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:13.445555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135f4df-131b-42d7-a433-f1afd4b09f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:13.467873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f135f4df-131b-42d7-a433-f1afd4b09f39 None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:13.469420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f135f4df-131b-42d7-a433-f1afd4b09f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:13.479862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1192/2394] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:13.487351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c302d8-7007-47de-87bc-a298367d5ff5 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:13.487933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c302d8-7007-47de-87bc-a298367d5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:13.488421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c302d8-7007-47de-87bc-a298367d5ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:13.513454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f1c302d8-7007-47de-87bc-a298367d5ff5 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:13.515155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f1c302d8-7007-47de-87bc-a298367d5ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:13.525393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1193/2395] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:45:13.529855 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c302d8-7007-47de-87bc-a298367d5ff5 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:13.543277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c302d8-7007-47de-87bc-a298367d5ff5 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:13.549032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:13.549725 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:13.550180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:13.550467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:13.552482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:45:13.552807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:13.555133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:13.563027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1203/2396] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:45:13.568172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1194/2397] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:45:13.572721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135f4df-131b-42d7-a433-f1afd4b09f39 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:13.582931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:13.585040 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:13.585603 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135f4df-131b-42d7-a433-f1afd4b09f39 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:13.590841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8b7d6-55c6-4a7f-8280-8c5f11e3bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:13.591518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8b7d6-55c6-4a7f-8280-8c5f11e3bf7a admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:13.591810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8b7d6-55c6-4a7f-8280-8c5f11e3bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:13.592243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8b7d6-55c6-4a7f-8280-8c5f11e3bf7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:13.592958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8b7d6-55c6-4a7f-8280-8c5f11e3bf7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:13.595418 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8b7d6-55c6-4a7f-8280-8c5f11e3bf7a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:13.720172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1204/2398] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:45:13 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:13.721380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b080f0-d906-43d3-b458-dce917dc6224 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:13.724388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8b7d6-55c6-4a7f-8280-8c5f11e3bf7a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:13.831568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc379ba-489d-405d-bb48-cd4dd2b2c573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:13.832487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc379ba-489d-405d-bb48-cd4dd2b2c573 service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:13.833273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc379ba-489d-405d-bb48-cd4dd2b2c573 service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:13.833577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc379ba-489d-405d-bb48-cd4dd2b2c573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:13.872955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8b7d6-55c6-4a7f-8280-8c5f11e3bf7a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:13.879983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82c883-8d34-4fa7-8227-2839e9756689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:13.880671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82c883-8d34-4fa7-8227-2839e9756689 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:13.880961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82c883-8d34-4fa7-8227-2839e9756689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:13.881246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82c883-8d34-4fa7-8227-2839e9756689 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:13.881950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82c883-8d34-4fa7-8227-2839e9756689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:13.883955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82c883-8d34-4fa7-8227-2839e9756689 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:13.915368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc379ba-489d-405d-bb48-cd4dd2b2c573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:13.917334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc379ba-489d-405d-bb48-cd4dd2b2c573 service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:13.926609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1195/2399] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:45:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:45:14.031760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1205/2400] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:45:13 2022] POST /identity/v3/users => generated 286 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:14.033390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc379ba-489d-405d-bb48-cd4dd2b2c573 service swift] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:14.055995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc379ba-489d-405d-bb48-cd4dd2b2c573 service swift] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:14.055995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ade0-dbc7-476e-b47e-d7fc6d71d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:14.055995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ade0-dbc7-476e-b47e-d7fc6d71d7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:14.055995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ade0-dbc7-476e-b47e-d7fc6d71d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:14.056694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8ade0-dbc7-476e-b47e-d7fc6d71d7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:14.056694 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8ade0-dbc7-476e-b47e-d7fc6d71d7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:14.058288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8ade0-dbc7-476e-b47e-d7fc6d71d7d3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:14.068829 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1196/2401] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:45:14.073029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82c883-8d34-4fa7-8227-2839e9756689 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:14.083911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82c883-8d34-4fa7-8227-2839e9756689 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:14.089210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73854f-9461-4483-ae45-9cb89671ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:14.089342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73854f-9461-4483-ae45-9cb89671ee7a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:14.089620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73854f-9461-4483-ae45-9cb89671ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:14.089902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73854f-9461-4483-ae45-9cb89671ee7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:14.090666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73854f-9461-4483-ae45-9cb89671ee7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:14.092286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73854f-9461-4483-ae45-9cb89671ee7a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:14.108140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1206/2402] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:45:14.111833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ade0-dbc7-476e-b47e-d7fc6d71d7d3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:14.127604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8ade0-dbc7-476e-b47e-d7fc6d71d7d3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:14.134262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:14.138663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:14.138663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:14.138663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] PATH_INFO: `/v3/projects/9263efa240044d5f8c75c6acce7280ef/users/798c07c463124a12a7efa69d97dc3f86/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:14.159828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9263efa240044d5f8c75c6acce7280ef, user_id=798c07c463124a12a7efa69d97dc3f86, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:14.164387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:14.293384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1197/2403] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:14 2022] PUT /identity/v3/projects/9263efa240044d5f8c75c6acce7280ef/users/798c07c463124a12a7efa69d97dc3f86/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:14.293491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d149-8b53-41d6-b440-eaaa4b0d2919 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:14.293491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d149-8b53-41d6-b440-eaaa4b0d2919 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:14.293491 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d149-8b53-41d6-b440-eaaa4b0d2919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:14.391337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-77f8d149-8b53-41d6-b440-eaaa4b0d2919 None None] MFA Rules not processed for user `798c07c463124a12a7efa69d97dc3f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:14.394946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-77f8d149-8b53-41d6-b440-eaaa4b0d2919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:14.637777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1207/2404] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:14.639724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:14.642615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:14.739677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae0f57-6136-4be3-ba57-551a19c48ee4 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:14.744541 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330337-837e-49a7-a402-cb33eae803e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:14.745213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330337-837e-49a7-a402-cb33eae803e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:14.745505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330337-837e-49a7-a402-cb33eae803e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:14.745846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330337-837e-49a7-a402-cb33eae803e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:14.756241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff330337-837e-49a7-a402-cb33eae803e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:14.757705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff330337-837e-49a7-a402-cb33eae803e9 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:14.779691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1198/2405] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:14.824853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d149-8b53-41d6-b440-eaaa4b0d2919 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:14.954615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d149-8b53-41d6-b440-eaaa4b0d2919 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:14.969717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:14.970796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:14.971123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:14.971410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] PATH_INFO: `/v3/users/798c07c463124a12a7efa69d97dc3f86` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:14.979586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=798c07c463124a12a7efa69d97dc3f86)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:14.981607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:15.276757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798c07c463124a12a7efa69d97dc3f86'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:15.285297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798c07c463124a12a7efa69d97dc3f86'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:15.286601 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798c07c463124a12a7efa69d97dc3f86'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:15.287231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798c07c463124a12a7efa69d97dc3f86'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:15.361261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798c07c463124a12a7efa69d97dc3f86'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:15.394204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1208/2406] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:45:14 2022] DELETE /identity/v3/users/798c07c463124a12a7efa69d97dc3f86 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:15.398792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0813a5-f64c-4457-a673-51ba50e9b5df None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:15.405838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0813a5-f64c-4457-a673-51ba50e9b5df None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:15.405838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0813a5-f64c-4457-a673-51ba50e9b5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:15.421944 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-fc0813a5-f64c-4457-a673-51ba50e9b5df None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:15.423307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fc0813a5-f64c-4457-a673-51ba50e9b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:15.480845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1199/2407] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:15.492887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:15.495712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:15.570005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc01ef-fef0-47fe-97eb-ade83b858e9e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:15.575929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adedecfb-dcd1-4524-b316-7874640cb7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:15.576874 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedecfb-dcd1-4524-b316-7874640cb7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:15.577440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedecfb-dcd1-4524-b316-7874640cb7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:15.577876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adedecfb-dcd1-4524-b316-7874640cb7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:15.589579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedecfb-dcd1-4524-b316-7874640cb7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:15.591113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adedecfb-dcd1-4524-b316-7874640cb7a7 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:15.602294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1209/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:16.064788 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0813a5-f64c-4457-a673-51ba50e9b5df None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:16.066570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fc0813a5-f64c-4457-a673-51ba50e9b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:16.086579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0813a5-f64c-4457-a673-51ba50e9b5df None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:16.091433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:16.092311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.092632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.092883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] PATH_INFO: `/v3/projects/9263efa240044d5f8c75c6acce7280ef` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.094180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9263efa240044d5f8c75c6acce7280ef)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:16.096324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:16.236456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9263efa240044d5f8c75c6acce7280ef', 'request_id': 'req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:16.333843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9263efa240044d5f8c75c6acce7280ef', 'request_id': 'req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:16.340939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9263efa240044d5f8c75c6acce7280ef', 'request_id': 'req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:16.352666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] The token cache is being invalidate because project 9263efa240044d5f8c75c6acce7280ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:45:16.353030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:16.353699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3aa99ffe-e55b-4777-bdea-d9c09ab9e4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:16.355548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1200/2409] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:45:16 2022] DELETE /identity/v3/projects/9263efa240044d5f8c75c6acce7280ef => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:16.360434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba50a-6427-4d9c-929d-be602ce4d525 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.360961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba50a-6427-4d9c-929d-be602ce4d525 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.360961 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ba50a-6427-4d9c-929d-be602ce4d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.386099 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ce9ba50a-6427-4d9c-929d-be602ce4d525 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:16.387375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ce9ba50a-6427-4d9c-929d-be602ce4d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:16.462025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1210/2410] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:16.469974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80b8c-251c-4440-b8f3-cb2554690a57 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.470295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80b8c-251c-4440-b8f3-cb2554690a57 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.470666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe80b8c-251c-4440-b8f3-cb2554690a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.492043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-0fe80b8c-251c-4440-b8f3-cb2554690a57 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:16.493362 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0fe80b8c-251c-4440-b8f3-cb2554690a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:16.507299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1201/2411] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:16.508195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ba50a-6427-4d9c-929d-be602ce4d525 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:16.518933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ba50a-6427-4d9c-929d-be602ce4d525 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:16.524246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:16.524922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.526776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.527501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.529001 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:45:16.529615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:16.532197 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:16.552071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1211/2412] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:45:16.553076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe80b8c-251c-4440-b8f3-cb2554690a57 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:16.567497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe80b8c-251c-4440-b8f3-cb2554690a57 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:16.572211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dabef2-5193-4e4d-a185-54aeb482322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:16.573039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dabef2-5193-4e4d-a185-54aeb482322d admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.573335 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dabef2-5193-4e4d-a185-54aeb482322d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.573674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dabef2-5193-4e4d-a185-54aeb482322d admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.574314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dabef2-5193-4e4d-a185-54aeb482322d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:16.576452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dabef2-5193-4e4d-a185-54aeb482322d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:16.676309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1202/2413] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:45:16 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:45:16.678061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:16.694139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402850-387d-4bb9-b7ea-7e56b35fd05a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:16.753754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31fb76-74f6-44da-b40f-e39bad6e96e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:16.754445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31fb76-74f6-44da-b40f-e39bad6e96e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.754788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31fb76-74f6-44da-b40f-e39bad6e96e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.755076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31fb76-74f6-44da-b40f-e39bad6e96e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.755779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31fb76-74f6-44da-b40f-e39bad6e96e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:16.757722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31fb76-74f6-44da-b40f-e39bad6e96e2 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:16.844186 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1212/2414] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:45:16 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:45:16.848709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dabef2-5193-4e4d-a185-54aeb482322d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:16.863408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dabef2-5193-4e4d-a185-54aeb482322d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:16.869236 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887ee40-464c-4d02-827c-c81553177a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:16.870041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887ee40-464c-4d02-827c-c81553177a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.870336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887ee40-464c-4d02-827c-c81553177a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.870636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887ee40-464c-4d02-827c-c81553177a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.871375 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887ee40-464c-4d02-827c-c81553177a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:16.873045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887ee40-464c-4d02-827c-c81553177a9f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:16.887933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1203/2415] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:16.893266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31fb76-74f6-44da-b40f-e39bad6e96e2 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:16.906495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31fb76-74f6-44da-b40f-e39bad6e96e2 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:16.912711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208470-596b-44d4-b249-5e36ff90181a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:16.913431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208470-596b-44d4-b249-5e36ff90181a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.914018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208470-596b-44d4-b249-5e36ff90181a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.914386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208470-596b-44d4-b249-5e36ff90181a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.915247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208470-596b-44d4-b249-5e36ff90181a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:16.916994 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208470-596b-44d4-b249-5e36ff90181a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:16.928078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1213/2416] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:16.932198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887ee40-464c-4d02-827c-c81553177a9f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:16.942794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887ee40-464c-4d02-827c-c81553177a9f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:16.947337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:16.948206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:16.948486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:16.948758 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] PATH_INFO: `/v3/projects/be038ca8cc894510beac07fcbcd346da/users/bd8df91056324f629d27d9d6db94c6de/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:16.962606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be038ca8cc894510beac07fcbcd346da, user_id=bd8df91056324f629d27d9d6db94c6de, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:16.965242 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:17.058141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1204/2417] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:16 2022] PUT /identity/v3/projects/be038ca8cc894510beac07fcbcd346da/users/bd8df91056324f629d27d9d6db94c6de/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:45:17.060207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f000fe-09dc-4aa9-949a-7a7e8b9d0701 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:17.060461 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f000fe-09dc-4aa9-949a-7a7e8b9d0701 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:17.060748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f000fe-09dc-4aa9-949a-7a7e8b9d0701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:17.090936 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a9f000fe-09dc-4aa9-949a-7a7e8b9d0701 None None] MFA Rules not processed for user `bd8df91056324f629d27d9d6db94c6de`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:17.092170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a9f000fe-09dc-4aa9-949a-7a7e8b9d0701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:17.168683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1214/2418] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:17.180478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:17.182258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:17.281934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9535-07eb-48c8-8511-04ae484949c8 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:17.293865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f2a360a89548208edd5fdff1a04e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:17.294563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:17.294859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:17.295137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:17.308504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:17.310589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:17.323978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1205/2419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:45:32.326417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492dddd-6e9b-4142-afa2-3dc1abbc3c18 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:32.326997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492dddd-6e9b-4142-afa2-3dc1abbc3c18 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:32.326997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492dddd-6e9b-4142-afa2-3dc1abbc3c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:32.345964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-6492dddd-6e9b-4142-afa2-3dc1abbc3c18 None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:32.347244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6492dddd-6e9b-4142-afa2-3dc1abbc3c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:32.410665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1215/2420] 10.222.0.43 () {58 vars in 967 bytes} [Thu Apr 28 16:45:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:32.427729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:32.429629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:32.532582 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fefa4c-7e61-4182-947f-0de2df1f0b84 service glance] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:32.537778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:32.538327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:32.538667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:32.538947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:32.548443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:32.550153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:32.559164 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1206/2421] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:45:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 16:45:40.843525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492dddd-6e9b-4142-afa2-3dc1abbc3c18 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:40.844982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6492dddd-6e9b-4142-afa2-3dc1abbc3c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:40.907182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492dddd-6e9b-4142-afa2-3dc1abbc3c18 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:40.911051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:40.911676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:40.911989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:40.912269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:40.914291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:40.986040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:40.987579 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:41.002793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1216/2422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:44.697059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:44.699219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:44.715757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678b352-1497-4212-a280-56f8812f96f7 service swift] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:44.720513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:44.721670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:44.724241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:44.724241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] PATH_INFO: `/v3/users/0557cb45047b49818d049d5b1bb7f49f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:44.724241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0557cb45047b49818d049d5b1bb7f49f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:44.726439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:44.881288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0557cb45047b49818d049d5b1bb7f49f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:44.881948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0557cb45047b49818d049d5b1bb7f49f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:44.890791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0557cb45047b49818d049d5b1bb7f49f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:44.895831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0557cb45047b49818d049d5b1bb7f49f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:44.941792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-aa5b257c-f01b-4447-9a4c-1deddc5150da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0557cb45047b49818d049d5b1bb7f49f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:44.960511 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1207/2423] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:45:44 2022] DELETE /identity/v3/users/0557cb45047b49818d049d5b1bb7f49f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:45:45.222383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:45.245147 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bddb03-e866-4207-957c-803a6ad511ef service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:45.306504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:45.307409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:45.307701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:45.307974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] PATH_INFO: `/v3/projects/365a8e17d27f40e1a3c9cf4864bc0c8a` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:45.309245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365a8e17d27f40e1a3c9cf4864bc0c8a)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:45.311142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:45.415867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365a8e17d27f40e1a3c9cf4864bc0c8a', 'request_id': 'req-505a96a3-b2c7-4e7f-9f87-806a62901961'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:45.519035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365a8e17d27f40e1a3c9cf4864bc0c8a', 'request_id': 'req-505a96a3-b2c7-4e7f-9f87-806a62901961'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:45.525266 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365a8e17d27f40e1a3c9cf4864bc0c8a', 'request_id': 'req-505a96a3-b2c7-4e7f-9f87-806a62901961'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:45.540894 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] The token cache is being invalidate because project 365a8e17d27f40e1a3c9cf4864bc0c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:45:45.541197 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:45.541862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-505a96a3-b2c7-4e7f-9f87-806a62901961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:45.544085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1217/2424] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:45:45 2022] DELETE /identity/v3/projects/365a8e17d27f40e1a3c9cf4864bc0c8a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:45.549185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd726e7-df94-430f-8f91-7d264f0fd844 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:45.549476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd726e7-df94-430f-8f91-7d264f0fd844 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:45.556800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd726e7-df94-430f-8f91-7d264f0fd844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:45.569515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-fcd726e7-df94-430f-8f91-7d264f0fd844 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:45.570795 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fcd726e7-df94-430f-8f91-7d264f0fd844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:45.629949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1208/2425] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:45.637787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651bbad-c0a7-4bd2-aa97-612f28d193fe None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:45.638082 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651bbad-c0a7-4bd2-aa97-612f28d193fe None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:45.638364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651bbad-c0a7-4bd2-aa97-612f28d193fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:45.657546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-3651bbad-c0a7-4bd2-aa97-612f28d193fe None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:45.658804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3651bbad-c0a7-4bd2-aa97-612f28d193fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:45.667086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1218/2426] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:45.671657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd726e7-df94-430f-8f91-7d264f0fd844 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:45.681472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd726e7-df94-430f-8f91-7d264f0fd844 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:45.686149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:45.686886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:45.696846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:45.696846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:45.696846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:45:45.696846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:45.696846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:45.701771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1209/2427] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:45:45.706186 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651bbad-c0a7-4bd2-aa97-612f28d193fe None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:45.716504 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651bbad-c0a7-4bd2-aa97-612f28d193fe None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:45.721222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c119-5598-4791-8cb8-9ae43e6999c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:45.721866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c119-5598-4791-8cb8-9ae43e6999c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:45.722149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c119-5598-4791-8cb8-9ae43e6999c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:45.722422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8c119-5598-4791-8cb8-9ae43e6999c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:45.723153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8c119-5598-4791-8cb8-9ae43e6999c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:45.725049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8c119-5598-4791-8cb8-9ae43e6999c8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:45.811112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1219/2428] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:45:45 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:45.815388 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:45.825524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10667f-b5e9-4e5c-8a95-e5a40093b82a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:45.893833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32a06-5cd4-4141-ae1b-b37acc84c388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:45.894645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32a06-5cd4-4141-ae1b-b37acc84c388 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:45.894934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32a06-5cd4-4141-ae1b-b37acc84c388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:45.895213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef32a06-5cd4-4141-ae1b-b37acc84c388 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:45.895949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef32a06-5cd4-4141-ae1b-b37acc84c388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:45.897988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef32a06-5cd4-4141-ae1b-b37acc84c388 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:45.964963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1210/2429] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:45:45 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:45:45.969985 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c119-5598-4791-8cb8-9ae43e6999c8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:45.980393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8c119-5598-4791-8cb8-9ae43e6999c8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:45.985085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbc2a0-6796-47aa-b31e-7d862e1b177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:45.985745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbc2a0-6796-47aa-b31e-7d862e1b177e admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:45.986033 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbc2a0-6796-47aa-b31e-7d862e1b177e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:45.986311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbc2a0-6796-47aa-b31e-7d862e1b177e admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:45.987078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbc2a0-6796-47aa-b31e-7d862e1b177e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:45.988678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdbc2a0-6796-47aa-b31e-7d862e1b177e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:45.998922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1220/2430] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:46.003585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32a06-5cd4-4141-ae1b-b37acc84c388 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.014670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef32a06-5cd4-4141-ae1b-b37acc84c388 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:46.019533 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d0f69-32ad-41f2-910b-f582d316ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:46.020190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0f69-32ad-41f2-910b-f582d316ff74 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.020482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0f69-32ad-41f2-910b-f582d316ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.020763 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0f69-32ad-41f2-910b-f582d316ff74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.021504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d0f69-32ad-41f2-910b-f582d316ff74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:46.023137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d0f69-32ad-41f2-910b-f582d316ff74 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:46.033918 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1211/2431] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:45:46.039422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbc2a0-6796-47aa-b31e-7d862e1b177e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.049771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbc2a0-6796-47aa-b31e-7d862e1b177e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:46.054422 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23791f-69ca-4b9a-b400-8e6b7a9bb7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:46.055335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23791f-69ca-4b9a-b400-8e6b7a9bb7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.055623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23791f-69ca-4b9a-b400-8e6b7a9bb7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.055900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23791f-69ca-4b9a-b400-8e6b7a9bb7af admin admin] PATH_INFO: `/v3/projects/f4f589dd870c4e2f879ff3981ff1441b/users/57cf5c548f59408bb51b1a325f47ff76/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.070315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23791f-69ca-4b9a-b400-8e6b7a9bb7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f589dd870c4e2f879ff3981ff1441b, user_id=57cf5c548f59408bb51b1a325f47ff76, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:46.072962 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23791f-69ca-4b9a-b400-8e6b7a9bb7af admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:46.159408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1221/2432] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:46 2022] PUT /identity/v3/projects/f4f589dd870c4e2f879ff3981ff1441b/users/57cf5c548f59408bb51b1a325f47ff76/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:46.170133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db18139-423c-43c2-8632-e707a0bf032d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.170434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db18139-423c-43c2-8632-e707a0bf032d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.170755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db18139-423c-43c2-8632-e707a0bf032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.196778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6db18139-423c-43c2-8632-e707a0bf032d None None] MFA Rules not processed for user `57cf5c548f59408bb51b1a325f47ff76`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:46.198002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6db18139-423c-43c2-8632-e707a0bf032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:46.259568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1212/2433] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:46.264478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23791f-69ca-4b9a-b400-8e6b7a9bb7af admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.326088 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23791f-69ca-4b9a-b400-8e6b7a9bb7af admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:46.330823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cb7ab-9f6e-4337-82af-2128a91c1719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:46.331483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cb7ab-9f6e-4337-82af-2128a91c1719 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.331771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cb7ab-9f6e-4337-82af-2128a91c1719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.332055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cb7ab-9f6e-4337-82af-2128a91c1719 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.332756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cb7ab-9f6e-4337-82af-2128a91c1719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:46.334712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cb7ab-9f6e-4337-82af-2128a91c1719 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:46.406530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1222/2434] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:45:46 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:46.410566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db18139-423c-43c2-8632-e707a0bf032d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.421271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db18139-423c-43c2-8632-e707a0bf032d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:46.475481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb532b-acb8-4995-a229-54742c16af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:46.476179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb532b-acb8-4995-a229-54742c16af26 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.476467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb532b-acb8-4995-a229-54742c16af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.476744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb532b-acb8-4995-a229-54742c16af26 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.477445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb532b-acb8-4995-a229-54742c16af26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:46.479399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb532b-acb8-4995-a229-54742c16af26 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:46.568281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1213/2435] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:45:46 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:46.569462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cb7ab-9f6e-4337-82af-2128a91c1719 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.581607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cb7ab-9f6e-4337-82af-2128a91c1719 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:46.586501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7463069-6604-437d-afad-f736d518e0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:46.587316 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7463069-6604-437d-afad-f736d518e0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.587605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7463069-6604-437d-afad-f736d518e0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.587885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7463069-6604-437d-afad-f736d518e0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.591582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7463069-6604-437d-afad-f736d518e0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:46.591582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7463069-6604-437d-afad-f736d518e0c3 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:46.600927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1223/2436] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:46.605331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb532b-acb8-4995-a229-54742c16af26 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.615326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb532b-acb8-4995-a229-54742c16af26 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:46.620288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d05cf6-0b5b-40f6-8fce-de25ed77657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:46.620875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05cf6-0b5b-40f6-8fce-de25ed77657f admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.621162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05cf6-0b5b-40f6-8fce-de25ed77657f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.621447 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d05cf6-0b5b-40f6-8fce-de25ed77657f admin admin] PATH_INFO: `/v3/projects/51f30677ed244cb4a4f6a9d2958a7aac/users/8ee2ca660e70402c81290c273f69489f/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.636328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d05cf6-0b5b-40f6-8fce-de25ed77657f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f30677ed244cb4a4f6a9d2958a7aac, user_id=8ee2ca660e70402c81290c273f69489f, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:46.639635 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d05cf6-0b5b-40f6-8fce-de25ed77657f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:46.713274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1214/2437] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:46 2022] PUT /identity/v3/projects/51f30677ed244cb4a4f6a9d2958a7aac/users/8ee2ca660e70402c81290c273f69489f/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:46.717237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7463069-6604-437d-afad-f736d518e0c3 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.727218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7463069-6604-437d-afad-f736d518e0c3 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:46.783860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92ddcf-8990-43a3-885d-b22b250ce977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:46.784428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92ddcf-8990-43a3-885d-b22b250ce977 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.784717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92ddcf-8990-43a3-885d-b22b250ce977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.784995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92ddcf-8990-43a3-885d-b22b250ce977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.785731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92ddcf-8990-43a3-885d-b22b250ce977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:46.787367 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92ddcf-8990-43a3-885d-b22b250ce977 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:46.797645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1224/2438] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:46.801771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d05cf6-0b5b-40f6-8fce-de25ed77657f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.812978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d05cf6-0b5b-40f6-8fce-de25ed77657f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:46.817697 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:46.818621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.818903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.819177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] PATH_INFO: `/v3/projects/51f30677ed244cb4a4f6a9d2958a7aac/users/8ee2ca660e70402c81290c273f69489f/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.821187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f30677ed244cb4a4f6a9d2958a7aac, user_id=8ee2ca660e70402c81290c273f69489f, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:46.823891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:46.834419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1215/2439] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:46 2022] PUT /identity/v3/projects/51f30677ed244cb4a4f6a9d2958a7aac/users/8ee2ca660e70402c81290c273f69489f/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:45:46.844276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed813-3853-4e4d-9903-f314cd3f6c4f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:46.844574 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed813-3853-4e4d-9903-f314cd3f6c4f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:46.844860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed813-3853-4e4d-9903-f314cd3f6c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:46.870653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a06ed813-3853-4e4d-9903-f314cd3f6c4f None None] MFA Rules not processed for user `8ee2ca660e70402c81290c273f69489f`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:46.871860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a06ed813-3853-4e4d-9903-f314cd3f6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:46.941337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1225/2440] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:46.953230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:46.955070 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:47.013134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963c0dd-e4e9-4b11-8f5c-9ab51ad0526d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:47.017210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:47.017867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:47.018155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:47.018433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:47.028210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:47.030134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:47.044064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1216/2441] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:47.281977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed813-3853-4e4d-9903-f314cd3f6c4f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:47.291625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed813-3853-4e4d-9903-f314cd3f6c4f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:47.296885 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a0b25-a311-44a1-a3b5-29898cc40721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:47.299213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0b25-a311-44a1-a3b5-29898cc40721 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:47.299213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0b25-a311-44a1-a3b5-29898cc40721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:47.299213 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0b25-a311-44a1-a3b5-29898cc40721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:47.356844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a0b25-a311-44a1-a3b5-29898cc40721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:47.358403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a0b25-a311-44a1-a3b5-29898cc40721 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:47.368253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1226/2442] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:50.388936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:50.390333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:50.453742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527159-f2d2-497d-8e17-6dac03d2d754 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:50.458211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:50.459241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:50.459590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:50.459894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] PATH_INFO: `/v3/users/bd8df91056324f629d27d9d6db94c6de` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:50.461076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8df91056324f629d27d9d6db94c6de)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:50.463022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:50.675187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8df91056324f629d27d9d6db94c6de'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:50.675840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8df91056324f629d27d9d6db94c6de'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:50.685604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8df91056324f629d27d9d6db94c6de'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:50.686277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8df91056324f629d27d9d6db94c6de'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:50.753010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8df91056324f629d27d9d6db94c6de'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:50.770314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1217/2443] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:45:50 2022] DELETE /identity/v3/users/bd8df91056324f629d27d9d6db94c6de => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:50.774815 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21eb63-335e-4078-aae6-ea854b685dae None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:50.775299 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21eb63-335e-4078-aae6-ea854b685dae None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:50.775415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21eb63-335e-4078-aae6-ea854b685dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:50.793249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-2c21eb63-335e-4078-aae6-ea854b685dae None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:50.794460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2c21eb63-335e-4078-aae6-ea854b685dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:50.852341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1227/2444] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:50.862749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:50.864225 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:50.919602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836051ca-75fc-435b-9d1c-f5556d46d23d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:50.923956 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f6c10-1a4f-4ef1-81d5-b009bc37c5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:50.924599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6c10-1a4f-4ef1-81d5-b009bc37c5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:50.924886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6c10-1a4f-4ef1-81d5-b009bc37c5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:50.925167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f6c10-1a4f-4ef1-81d5-b009bc37c5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:50.934497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f6c10-1a4f-4ef1-81d5-b009bc37c5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:50.938819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f6c10-1a4f-4ef1-81d5-b009bc37c5c9 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:50.945567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1218/2445] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:51.325842 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21eb63-335e-4078-aae6-ea854b685dae None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:51.327464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2c21eb63-335e-4078-aae6-ea854b685dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:51.340311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21eb63-335e-4078-aae6-ea854b685dae None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:51.346038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:51.347327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:51.347767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:51.348197 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] PATH_INFO: `/v3/projects/be038ca8cc894510beac07fcbcd346da` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:51.349748 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=be038ca8cc894510beac07fcbcd346da)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:51.351891 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:51.455838 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be038ca8cc894510beac07fcbcd346da', 'request_id': 'req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:51.524500 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be038ca8cc894510beac07fcbcd346da', 'request_id': 'req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:51.530573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be038ca8cc894510beac07fcbcd346da', 'request_id': 'req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:51.541939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] The token cache is being invalidate because project be038ca8cc894510beac07fcbcd346da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:45:51.542237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:51.542901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8c59c4c4-bed6-44d1-b17c-32ca5906dc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:51.544441 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1228/2446] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:45:51 2022] DELETE /identity/v3/projects/be038ca8cc894510beac07fcbcd346da => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:51.549499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e676ef-7ad9-4e1e-a9e1-5ede923b9555 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:51.549951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e676ef-7ad9-4e1e-a9e1-5ede923b9555 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:51.550043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e676ef-7ad9-4e1e-a9e1-5ede923b9555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:51.568256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-55e676ef-7ad9-4e1e-a9e1-5ede923b9555 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:51.569534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-55e676ef-7ad9-4e1e-a9e1-5ede923b9555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:51.627460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1219/2447] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:51.635247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9b1b-be6f-4090-90ae-006c9ee41153 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:51.635539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9b1b-be6f-4090-90ae-006c9ee41153 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:51.635820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f9b1b-be6f-4090-90ae-006c9ee41153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:51.655385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-854f9b1b-be6f-4090-90ae-006c9ee41153 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:51.656586 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-854f9b1b-be6f-4090-90ae-006c9ee41153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:51.664433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1229/2448] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:51.668551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e676ef-7ad9-4e1e-a9e1-5ede923b9555 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:51.678032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e676ef-7ad9-4e1e-a9e1-5ede923b9555 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:51.682547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:51.683202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:51.683484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:51.683756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:51.684480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:45:51.684785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:51.686361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:51.697878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1220/2449] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:45:51.702077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f9b1b-be6f-4090-90ae-006c9ee41153 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:51.712019 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f9b1b-be6f-4090-90ae-006c9ee41153 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:51.716879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910429-5bcf-46d3-9052-d4ae7176e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:51.717519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910429-5bcf-46d3-9052-d4ae7176e3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:51.717804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910429-5bcf-46d3-9052-d4ae7176e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:51.718080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910429-5bcf-46d3-9052-d4ae7176e3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:51.718844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3910429-5bcf-46d3-9052-d4ae7176e3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:51.720832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3910429-5bcf-46d3-9052-d4ae7176e3f1 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:51.818484 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1230/2450] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:45:51 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:45:51.822910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:51.833726 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2644830-cf29-4339-9064-3c5db4d21e0e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:51.889441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b1871-362d-4c49-9e1f-cda4f3dcc23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:51.890032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1871-362d-4c49-9e1f-cda4f3dcc23d admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:51.890314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1871-362d-4c49-9e1f-cda4f3dcc23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:51.890655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1871-362d-4c49-9e1f-cda4f3dcc23d admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:51.891346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b1871-362d-4c49-9e1f-cda4f3dcc23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:51.893253 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b1871-362d-4c49-9e1f-cda4f3dcc23d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:51.964466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1221/2451] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:45:51 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:45:51.968620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910429-5bcf-46d3-9052-d4ae7176e3f1 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:51.979115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910429-5bcf-46d3-9052-d4ae7176e3f1 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:51.983785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695131ec-bb57-4923-be6f-0efc2f062f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:51.984926 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695131ec-bb57-4923-be6f-0efc2f062f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:51.985209 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695131ec-bb57-4923-be6f-0efc2f062f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:51.985487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695131ec-bb57-4923-be6f-0efc2f062f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:51.986236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695131ec-bb57-4923-be6f-0efc2f062f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:51.987865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695131ec-bb57-4923-be6f-0efc2f062f8d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:51.998087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1231/2452] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:52.002524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b1871-362d-4c49-9e1f-cda4f3dcc23d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:52.012286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b1871-362d-4c49-9e1f-cda4f3dcc23d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:52.016868 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e0a43-0202-4aa2-9cc7-2b66fa3114d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:52.023982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e0a43-0202-4aa2-9cc7-2b66fa3114d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:52.023982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e0a43-0202-4aa2-9cc7-2b66fa3114d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:52.023982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e0a43-0202-4aa2-9cc7-2b66fa3114d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:52.023982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e0a43-0202-4aa2-9cc7-2b66fa3114d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:52.023982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e0a43-0202-4aa2-9cc7-2b66fa3114d0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:52.030252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1222/2453] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:45:52.034291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695131ec-bb57-4923-be6f-0efc2f062f8d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:52.044383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695131ec-bb57-4923-be6f-0efc2f062f8d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:52.049898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:52.050730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:52.051016 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:52.051292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] PATH_INFO: `/v3/projects/a763aed5d5244d5cbf5b30987a1d67ab/users/48d54457f1814de6851f47d153eb4014/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:52.067154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a763aed5d5244d5cbf5b30987a1d67ab, user_id=48d54457f1814de6851f47d153eb4014, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:52.069896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:52.135975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1232/2454] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:45:52 2022] PUT /identity/v3/projects/a763aed5d5244d5cbf5b30987a1d67ab/users/48d54457f1814de6851f47d153eb4014/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:52.148061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd219a7-170b-4b83-b790-b85b54509c20 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:52.148298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd219a7-170b-4b83-b790-b85b54509c20 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:52.148602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd219a7-170b-4b83-b790-b85b54509c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:52.175140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ecd219a7-170b-4b83-b790-b85b54509c20 None None] MFA Rules not processed for user `48d54457f1814de6851f47d153eb4014`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:52.176333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ecd219a7-170b-4b83-b790-b85b54509c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:52.241548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1223/2455] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:52.252363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:52.254063 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:52.309818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af32fa0-c51d-419c-9f14-1224c347a2d4 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:52.313569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b56ac-4de9-4cf9-b507-12b36c2dd652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:52.314204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b56ac-4de9-4cf9-b507-12b36c2dd652 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:52.314489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b56ac-4de9-4cf9-b507-12b36c2dd652 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:52.314796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b56ac-4de9-4cf9-b507-12b36c2dd652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:52.322863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b56ac-4de9-4cf9-b507-12b36c2dd652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:52.324284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b56ac-4de9-4cf9-b507-12b36c2dd652 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:52.332954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1233/2456] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:54.253106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd219a7-170b-4b83-b790-b85b54509c20 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:54.254644 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ecd219a7-170b-4b83-b790-b85b54509c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:54.313405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd219a7-170b-4b83-b790-b85b54509c20 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:54.317131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:54.317774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:54.318059 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:54.318344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:54.320129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:54.377576 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:54.379200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:54.388250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1224/2457] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:54.990328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a66f5-a491-4127-a538-3ca12033b94a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:54.990915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a66f5-a491-4127-a538-3ca12033b94a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:54.990915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a66f5-a491-4127-a538-3ca12033b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:55.009619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ea9a66f5-a491-4127-a538-3ca12033b94a None None] MFA Rules not processed for user `48d54457f1814de6851f47d153eb4014`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:55.010981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ea9a66f5-a491-4127-a538-3ca12033b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:55.018410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1234/2458] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:58.757113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:58.758668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:58.828636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e44f-698b-414f-882b-e4c807e9f5cf service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:58.834093 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:58.835010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:58.835292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:58.835569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] PATH_INFO: `/v3/users/57cf5c548f59408bb51b1a325f47ff76` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:58.836765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57cf5c548f59408bb51b1a325f47ff76)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:58.838729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:59.032395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57cf5c548f59408bb51b1a325f47ff76'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:59.033378 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57cf5c548f59408bb51b1a325f47ff76'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:59.041643 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57cf5c548f59408bb51b1a325f47ff76'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:59.042834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57cf5c548f59408bb51b1a325f47ff76'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:59.136094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57cf5c548f59408bb51b1a325f47ff76'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:45:59.155283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1225/2459] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:45:58 2022] DELETE /identity/v3/users/57cf5c548f59408bb51b1a325f47ff76 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:45:59.160415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8a03-0dc5-4351-8eee-8b9c5c0daa0e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:59.160935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8a03-0dc5-4351-8eee-8b9c5c0daa0e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:59.161035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8a03-0dc5-4351-8eee-8b9c5c0daa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:59.180641 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d64e8a03-0dc5-4351-8eee-8b9c5c0daa0e None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:45:59.182022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d64e8a03-0dc5-4351-8eee-8b9c5c0daa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:59.243202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1235/2460] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:45:59.252810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:59.254251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:59.316494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfead398-c7d3-481a-b392-072df7493490 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:59.320451 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065fb1c-9ede-4967-bf78-1a3f0a3dbb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:59.321114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065fb1c-9ede-4967-bf78-1a3f0a3dbb1e service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:59.321406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065fb1c-9ede-4967-bf78-1a3f0a3dbb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:59.321740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065fb1c-9ede-4967-bf78-1a3f0a3dbb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:59.332475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065fb1c-9ede-4967-bf78-1a3f0a3dbb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:59.333958 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065fb1c-9ede-4967-bf78-1a3f0a3dbb1e service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:59.344599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1226/2461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:45:59.857360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8a03-0dc5-4351-8eee-8b9c5c0daa0e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:45:59.858904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d64e8a03-0dc5-4351-8eee-8b9c5c0daa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:45:59.871039 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8a03-0dc5-4351-8eee-8b9c5c0daa0e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:45:59.876283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:45:59.877151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:45:59.877507 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:45:59.877795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] PATH_INFO: `/v3/projects/f4f589dd870c4e2f879ff3981ff1441b` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:45:59.879134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f589dd870c4e2f879ff3981ff1441b)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:45:59.886024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:45:59.994008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f589dd870c4e2f879ff3981ff1441b', 'request_id': 'req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.119170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f589dd870c4e2f879ff3981ff1441b', 'request_id': 'req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.128717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f589dd870c4e2f879ff3981ff1441b', 'request_id': 'req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.142971 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] The token cache is being invalidate because project f4f589dd870c4e2f879ff3981ff1441b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:00.143296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.143924 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.145899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1236/2462] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:45:59 2022] DELETE /identity/v3/projects/f4f589dd870c4e2f879ff3981ff1441b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:00.152563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065fb1c-9ede-4967-bf78-1a3f0a3dbb1e service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:00.168137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065fb1c-9ede-4967-bf78-1a3f0a3dbb1e service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:00.246483 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:00.247403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:00.247931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:00.248167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] PATH_INFO: `/v3/users/8ee2ca660e70402c81290c273f69489f` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:00.250910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee2ca660e70402c81290c273f69489f)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:00.253948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:00.452230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee2ca660e70402c81290c273f69489f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.453055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee2ca660e70402c81290c273f69489f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.460298 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee2ca660e70402c81290c273f69489f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.460950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee2ca660e70402c81290c273f69489f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.524517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee2ca660e70402c81290c273f69489f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:00.543219 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1227/2463] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:00 2022] DELETE /identity/v3/users/8ee2ca660e70402c81290c273f69489f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:01.230237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:01.231819 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:01.267547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4a0c9-d4df-41b8-b24e-f0891bbe3643 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:01.348737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:01.349939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:01.350391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:01.350786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] PATH_INFO: `/v3/projects/51f30677ed244cb4a4f6a9d2958a7aac` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:01.359919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f30677ed244cb4a4f6a9d2958a7aac)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:01.359919 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:01.399189 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:01.400697 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:01.476072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d8f92-c3bc-4ce3-9458-b32b7a1a2ae8 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:01.484011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f30677ed244cb4a4f6a9d2958a7aac', 'request_id': 'req-b7b8c9ec-40db-4e91-8cda-6be18a946693'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:01.533805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ef217-a645-4c76-832a-a05c253f0dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:01.534461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ef217-a645-4c76-832a-a05c253f0dee service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:01.534793 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ef217-a645-4c76-832a-a05c253f0dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:01.535075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ef217-a645-4c76-832a-a05c253f0dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:01.536913 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e13ef217-a645-4c76-832a-a05c253f0dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:01.541583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f30677ed244cb4a4f6a9d2958a7aac', 'request_id': 'req-b7b8c9ec-40db-4e91-8cda-6be18a946693'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:01.548849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f30677ed244cb4a4f6a9d2958a7aac', 'request_id': 'req-b7b8c9ec-40db-4e91-8cda-6be18a946693'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:01.560941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] The token cache is being invalidate because project 51f30677ed244cb4a4f6a9d2958a7aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:01.561236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:01.562172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b7b8c9ec-40db-4e91-8cda-6be18a946693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:01.563960 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1237/2464] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:01 2022] DELETE /identity/v3/projects/51f30677ed244cb4a4f6a9d2958a7aac => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:01.569471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbd532-7052-4fa1-a648-5b628ab75082 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:01.570477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbd532-7052-4fa1-a648-5b628ab75082 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:01.570786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbd532-7052-4fa1-a648-5b628ab75082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:01.590062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-42cbd532-7052-4fa1-a648-5b628ab75082 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:01.591303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-42cbd532-7052-4fa1-a648-5b628ab75082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:01.614138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ef217-a645-4c76-832a-a05c253f0dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:01.615618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ef217-a645-4c76-832a-a05c253f0dee service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:01.626608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1228/2465] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:46:01.653282 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1238/2466] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:01.661896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449ddc-c3fb-424f-ad4f-770dc8a459dd None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:01.662216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449ddc-c3fb-424f-ad4f-770dc8a459dd None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:01.662496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5449ddc-c3fb-424f-ad4f-770dc8a459dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:01.684312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f5449ddc-c3fb-424f-ad4f-770dc8a459dd None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:01.685566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f5449ddc-c3fb-424f-ad4f-770dc8a459dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:01.694300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1229/2467] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:01.698675 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbd532-7052-4fa1-a648-5b628ab75082 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:01.710112 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbd532-7052-4fa1-a648-5b628ab75082 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:01.717690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:01.719339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:01.719635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:01.719920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:01.720665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:01.720979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:01.722622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:01.736738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1239/2468] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:46:01.741484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449ddc-c3fb-424f-ad4f-770dc8a459dd None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:01.752870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5449ddc-c3fb-424f-ad4f-770dc8a459dd None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:01.758290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f87e5c-9ed5-4932-a43f-5f7083e967b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:01.761971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f87e5c-9ed5-4932-a43f-5f7083e967b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:01.761971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f87e5c-9ed5-4932-a43f-5f7083e967b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:01.761971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f87e5c-9ed5-4932-a43f-5f7083e967b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:01.761971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f87e5c-9ed5-4932-a43f-5f7083e967b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:01.762502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f87e5c-9ed5-4932-a43f-5f7083e967b3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:01.881235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1230/2469] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:01 2022] POST /identity/v3/projects => generated 399 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:01.885396 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:01.895691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56449b8a-200e-4c0c-b329-3ba824469427 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:01.953002 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787a9c4-de68-4725-b53b-07d7e4948f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:01.954055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a9c4-de68-4725-b53b-07d7e4948f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:01.954055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a9c4-de68-4725-b53b-07d7e4948f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:01.954361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787a9c4-de68-4725-b53b-07d7e4948f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:01.955115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787a9c4-de68-4725-b53b-07d7e4948f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:01.957292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787a9c4-de68-4725-b53b-07d7e4948f89 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.037319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1240/2470] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:01 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:02.038970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f87e5c-9ed5-4932-a43f-5f7083e967b3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.050864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f87e5c-9ed5-4932-a43f-5f7083e967b3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.055779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962301c-d0a7-42e1-991b-33c71099cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.056460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962301c-d0a7-42e1-991b-33c71099cd94 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.056742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962301c-d0a7-42e1-991b-33c71099cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.057017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962301c-d0a7-42e1-991b-33c71099cd94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.057755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962301c-d0a7-42e1-991b-33c71099cd94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.059405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962301c-d0a7-42e1-991b-33c71099cd94 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.069994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1231/2471] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:02.080018 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787a9c4-de68-4725-b53b-07d7e4948f89 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.089935 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787a9c4-de68-4725-b53b-07d7e4948f89 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.095260 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4fa29-b5b9-4969-95f6-e111f68f6c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.095913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4fa29-b5b9-4969-95f6-e111f68f6c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.096194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4fa29-b5b9-4969-95f6-e111f68f6c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.096471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4fa29-b5b9-4969-95f6-e111f68f6c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.097193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4fa29-b5b9-4969-95f6-e111f68f6c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.098831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4fa29-b5b9-4969-95f6-e111f68f6c8c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.112489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1241/2472] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:02.113888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962301c-d0a7-42e1-991b-33c71099cd94 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.124151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962301c-d0a7-42e1-991b-33c71099cd94 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.128925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdbfc8-2da6-4485-a021-b0e9c0a0a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.129831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdbfc8-2da6-4485-a021-b0e9c0a0a267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.130114 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdbfc8-2da6-4485-a021-b0e9c0a0a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.130387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdbfc8-2da6-4485-a021-b0e9c0a0a267 admin admin] PATH_INFO: `/v3/projects/b42795ae6100481c8cd3555f48ea9294/users/667a2dfcb9c94ef9b4b6f80f34f1b004/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.144951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdbfc8-2da6-4485-a021-b0e9c0a0a267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42795ae6100481c8cd3555f48ea9294, user_id=667a2dfcb9c94ef9b4b6f80f34f1b004, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.148173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdbfc8-2da6-4485-a021-b0e9c0a0a267 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.216271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1232/2473] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:02 2022] PUT /identity/v3/projects/b42795ae6100481c8cd3555f48ea9294/users/667a2dfcb9c94ef9b4b6f80f34f1b004/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:02.228639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19262-d521-462f-b5f5-de75ca84b3c0 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.228940 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19262-d521-462f-b5f5-de75ca84b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.229228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19262-d521-462f-b5f5-de75ca84b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.256362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b0c19262-d521-462f-b5f5-de75ca84b3c0 None None] MFA Rules not processed for user `667a2dfcb9c94ef9b4b6f80f34f1b004`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:02.257609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b0c19262-d521-462f-b5f5-de75ca84b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:02.322380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1242/2474] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:02.326840 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdbfc8-2da6-4485-a021-b0e9c0a0a267 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.389767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdbfc8-2da6-4485-a021-b0e9c0a0a267 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.394681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf30b4-cbca-49a7-9fbc-8557b019b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.395425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf30b4-cbca-49a7-9fbc-8557b019b5dc admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.395642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf30b4-cbca-49a7-9fbc-8557b019b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.395922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf30b4-cbca-49a7-9fbc-8557b019b5dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.396626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf30b4-cbca-49a7-9fbc-8557b019b5dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.398568 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf30b4-cbca-49a7-9fbc-8557b019b5dc admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.535280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1233/2475] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:02 2022] POST /identity/v3/projects => generated 399 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:02.536439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c19262-d521-462f-b5f5-de75ca84b3c0 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.547610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c19262-d521-462f-b5f5-de75ca84b3c0 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.603413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98d18-d959-4838-8603-4dbf8475896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.604096 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98d18-d959-4838-8603-4dbf8475896d admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.604382 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98d18-d959-4838-8603-4dbf8475896d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.604680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98d18-d959-4838-8603-4dbf8475896d admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.605348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98d18-d959-4838-8603-4dbf8475896d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.607327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d98d18-d959-4838-8603-4dbf8475896d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.683928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1243/2476] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:02 2022] POST /identity/v3/users => generated 306 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:02.691584 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf30b4-cbca-49a7-9fbc-8557b019b5dc admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.700674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf30b4-cbca-49a7-9fbc-8557b019b5dc admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.706724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ebf5-785b-4f8f-ac9a-aa51a41cea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.718061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ebf5-785b-4f8f-ac9a-aa51a41cea95 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.718061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ebf5-785b-4f8f-ac9a-aa51a41cea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.718061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4ebf5-785b-4f8f-ac9a-aa51a41cea95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.718061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4ebf5-785b-4f8f-ac9a-aa51a41cea95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.718061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4ebf5-785b-4f8f-ac9a-aa51a41cea95 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.725558 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1234/2477] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:02.730147 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98d18-d959-4838-8603-4dbf8475896d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.741482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d98d18-d959-4838-8603-4dbf8475896d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.746349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b9117-9eca-42bd-8f69-99be00287e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.747536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b9117-9eca-42bd-8f69-99be00287e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.747822 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b9117-9eca-42bd-8f69-99be00287e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.748100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b9117-9eca-42bd-8f69-99be00287e49 admin admin] PATH_INFO: `/v3/projects/eccea295658446ad8c2c00a47896166a/users/5bb8a9b0d4a34051934f1abb791fcdd8/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.764236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b9117-9eca-42bd-8f69-99be00287e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccea295658446ad8c2c00a47896166a, user_id=5bb8a9b0d4a34051934f1abb791fcdd8, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.767689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b9117-9eca-42bd-8f69-99be00287e49 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.845423 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1244/2478] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:02 2022] PUT /identity/v3/projects/eccea295658446ad8c2c00a47896166a/users/5bb8a9b0d4a34051934f1abb791fcdd8/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:02.849349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ebf5-785b-4f8f-ac9a-aa51a41cea95 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.861619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4ebf5-785b-4f8f-ac9a-aa51a41cea95 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.918876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32039374-a649-410d-a7b0-bad4c712bb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.919448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32039374-a649-410d-a7b0-bad4c712bb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.919733 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32039374-a649-410d-a7b0-bad4c712bb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.920009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32039374-a649-410d-a7b0-bad4c712bb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.920734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32039374-a649-410d-a7b0-bad4c712bb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.922927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32039374-a649-410d-a7b0-bad4c712bb80 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.932586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1235/2479] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:02.936867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b9117-9eca-42bd-8f69-99be00287e49 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:02.947186 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b9117-9eca-42bd-8f69-99be00287e49 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:02.952073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:02.953065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.953350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.953658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] PATH_INFO: `/v3/projects/eccea295658446ad8c2c00a47896166a/users/5bb8a9b0d4a34051934f1abb791fcdd8/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:02.955677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccea295658446ad8c2c00a47896166a, user_id=5bb8a9b0d4a34051934f1abb791fcdd8, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:02.958375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:02.969138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1245/2480] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:02 2022] PUT /identity/v3/projects/eccea295658446ad8c2c00a47896166a/users/5bb8a9b0d4a34051934f1abb791fcdd8/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:02.979216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90276-ff74-47d1-826f-838994864d3f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:02.979503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90276-ff74-47d1-826f-838994864d3f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:02.979779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90276-ff74-47d1-826f-838994864d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:03.013094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f2e90276-ff74-47d1-826f-838994864d3f None None] MFA Rules not processed for user `5bb8a9b0d4a34051934f1abb791fcdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:03.014431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f2e90276-ff74-47d1-826f-838994864d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:03.088155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1236/2481] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:03.099556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:03.101304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:03.179080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1ecc4-fbf7-499f-9f00-3f447ca2166a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:03.185287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2783c9c-ff40-4672-a62b-fe6f1f0f64d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:03.186480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2783c9c-ff40-4672-a62b-fe6f1f0f64d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:03.190730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2783c9c-ff40-4672-a62b-fe6f1f0f64d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:03.190730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2783c9c-ff40-4672-a62b-fe6f1f0f64d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:03.203600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2783c9c-ff40-4672-a62b-fe6f1f0f64d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:03.206617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2783c9c-ff40-4672-a62b-fe6f1f0f64d0 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:03.216386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1246/2482] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:03.446632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e90276-ff74-47d1-826f-838994864d3f None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:03.458665 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e90276-ff74-47d1-826f-838994864d3f None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:03.462846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9718df8-6217-46e6-9794-def64da39452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:03.463500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718df8-6217-46e6-9794-def64da39452 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:03.463957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718df8-6217-46e6-9794-def64da39452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:03.464072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9718df8-6217-46e6-9794-def64da39452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:03.529377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9718df8-6217-46e6-9794-def64da39452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:03.531824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9718df8-6217-46e6-9794-def64da39452 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:03.542508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1237/2483] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:08.516967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2783c9c-ff40-4672-a62b-fe6f1f0f64d0 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:08.586831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2783c9c-ff40-4672-a62b-fe6f1f0f64d0 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:08.592621 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:08.593621 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:08.594007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:08.594306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] PATH_INFO: `/v3/users/667a2dfcb9c94ef9b4b6f80f34f1b004` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:08.595795 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667a2dfcb9c94ef9b4b6f80f34f1b004)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:08.597772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:08.843786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667a2dfcb9c94ef9b4b6f80f34f1b004'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:08.851517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667a2dfcb9c94ef9b4b6f80f34f1b004'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:08.852294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667a2dfcb9c94ef9b4b6f80f34f1b004'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:08.852912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667a2dfcb9c94ef9b4b6f80f34f1b004'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:08.964825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667a2dfcb9c94ef9b4b6f80f34f1b004'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:08.987568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1247/2484] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:08 2022] DELETE /identity/v3/users/667a2dfcb9c94ef9b4b6f80f34f1b004 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:08.991240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf5fb-dade-4210-8f3d-1f3716f7bb69 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:08.991742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf5fb-dade-4210-8f3d-1f3716f7bb69 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:08.992358 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf5fb-dade-4210-8f3d-1f3716f7bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:09.010001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-446cf5fb-dade-4210-8f3d-1f3716f7bb69 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:09.011413 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-446cf5fb-dade-4210-8f3d-1f3716f7bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:09.086999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1238/2485] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:09.094308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:09.095810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:09.153787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f807ebe-3edb-4bc4-9131-919cc66dc608 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:09.158360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:09.159049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:09.159334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:09.159610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:09.168910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:09.170293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:09.179967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1248/2486] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:09.548021 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cf5fb-dade-4210-8f3d-1f3716f7bb69 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:09.549742 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-446cf5fb-dade-4210-8f3d-1f3716f7bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:09.564528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cf5fb-dade-4210-8f3d-1f3716f7bb69 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:09.567487 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:09.568369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:09.568655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:09.568935 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] PATH_INFO: `/v3/users/93aaa10edc614d4c8185b66c3934d295` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:09.570229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93aaa10edc614d4c8185b66c3934d295)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:09.572190 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:09.588753 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:09.590240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:09.607993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8efdea-869d-4805-accd-7a04efc86c2b service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:09.612886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:09.613683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:09.614072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:09.614176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] PATH_INFO: `/v3/projects/b42795ae6100481c8cd3555f48ea9294` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:09.615393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42795ae6100481c8cd3555f48ea9294)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:09.617300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:09.738228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42795ae6100481c8cd3555f48ea9294', 'request_id': 'req-106139a7-3699-4597-82c5-d8a1d2de95cb'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.740383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93aaa10edc614d4c8185b66c3934d295'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.741364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93aaa10edc614d4c8185b66c3934d295'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.749845 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93aaa10edc614d4c8185b66c3934d295'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.750556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93aaa10edc614d4c8185b66c3934d295'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.781291 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42795ae6100481c8cd3555f48ea9294', 'request_id': 'req-106139a7-3699-4597-82c5-d8a1d2de95cb'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.787048 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42795ae6100481c8cd3555f48ea9294', 'request_id': 'req-106139a7-3699-4597-82c5-d8a1d2de95cb'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.798253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] The token cache is being invalidate because project b42795ae6100481c8cd3555f48ea9294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:09.798582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.799228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.800756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1249/2487] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:09 2022] DELETE /identity/v3/projects/b42795ae6100481c8cd3555f48ea9294 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:09.804696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:09.805976 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:09.821007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93aaa10edc614d4c8185b66c3934d295'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:09.839284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1239/2488] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:09 2022] DELETE /identity/v3/users/93aaa10edc614d4c8185b66c3934d295 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:09.869968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106139a7-3699-4597-82c5-d8a1d2de95cb admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:09.927707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:09.928571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:09.928914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:09.929306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] PATH_INFO: `/v3/users/5bb8a9b0d4a34051934f1abb791fcdd8` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:09.930439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb8a9b0d4a34051934f1abb791fcdd8)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:09.932468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:10.127022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:10.129173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:10.141628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb8a9b0d4a34051934f1abb791fcdd8'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.145212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607221d-6517-425c-bf7f-3f88869b86b8 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:10.151065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb8a9b0d4a34051934f1abb791fcdd8'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.151333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:10.151977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb8a9b0d4a34051934f1abb791fcdd8'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.152421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:10.153195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:10.153300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb8a9b0d4a34051934f1abb791fcdd8'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.153553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] PATH_INFO: `/v3/projects/002e55a552ac411ea3aa912031c2eced` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:10.154929 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=002e55a552ac411ea3aa912031c2eced)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:10.156923 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:10.232630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb8a9b0d4a34051934f1abb791fcdd8'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.251152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1250/2489] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:09 2022] DELETE /identity/v3/users/5bb8a9b0d4a34051934f1abb791fcdd8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:10.272675 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002e55a552ac411ea3aa912031c2eced', 'request_id': 'req-82ab0789-8a47-44a8-801a-1e60744eb74d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.341872 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002e55a552ac411ea3aa912031c2eced', 'request_id': 'req-82ab0789-8a47-44a8-801a-1e60744eb74d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.349460 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002e55a552ac411ea3aa912031c2eced', 'request_id': 'req-82ab0789-8a47-44a8-801a-1e60744eb74d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.362869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] The token cache is being invalidate because project 002e55a552ac411ea3aa912031c2eced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:10.363177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.364121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.365710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1240/2490] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:10 2022] DELETE /identity/v3/projects/002e55a552ac411ea3aa912031c2eced => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:10.373840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:10.373840 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:10.443753 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f5247-f476-4b16-a16c-63db11189415 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:10.505514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:10.506411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:10.511639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:10.511639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] PATH_INFO: `/v3/users/335bd425c08b449d899cc6f5627eeb10` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:10.511639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] RBAC: Authorizing `identity:delete_user(user_id=335bd425c08b449d899cc6f5627eeb10)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:10.511639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:10.687766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335bd425c08b449d899cc6f5627eeb10'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.694785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335bd425c08b449d899cc6f5627eeb10'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.695518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335bd425c08b449d899cc6f5627eeb10'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.696146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335bd425c08b449d899cc6f5627eeb10'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.743091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:10.745438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:10.758366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0789-8a47-44a8-801a-1e60744eb74d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:10.763155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:10.764320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:10.764320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:10.764595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] PATH_INFO: `/v3/projects/eccea295658446ad8c2c00a47896166a` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:10.765623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bdbd4ec9-4577-4547-818a-b0b1ab57065a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335bd425c08b449d899cc6f5627eeb10'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.765764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccea295658446ad8c2c00a47896166a)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:10.767723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:10.784729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1251/2491] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:10 2022] DELETE /identity/v3/users/335bd425c08b449d899cc6f5627eeb10 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:10.907162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccea295658446ad8c2c00a47896166a', 'request_id': 'req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.975274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccea295658446ad8c2c00a47896166a', 'request_id': 'req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.981052 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccea295658446ad8c2c00a47896166a', 'request_id': 'req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.993283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] The token cache is being invalidate because project eccea295658446ad8c2c00a47896166a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:10.993571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.994202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:10.995783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1241/2492] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:10 2022] DELETE /identity/v3/projects/eccea295658446ad8c2c00a47896166a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:11.005811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d267-e4c1-4acb-a346-4f28d47e9fc8 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.005811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d267-e4c1-4acb-a346-4f28d47e9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.005811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d267-e4c1-4acb-a346-4f28d47e9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.009424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:11.010883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:11.027888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c996d267-e4c1-4acb-a346-4f28d47e9fc8 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:11.029635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c996d267-e4c1-4acb-a346-4f28d47e9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:11.085303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6982-8e62-48a2-9c8f-9dd937c1bb6e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:11.092554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:11.095110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.095580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.096029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] PATH_INFO: `/v3/projects/400b3bf1b5024f47844ec7e895cbc5d9` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.097890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] RBAC: Authorizing `identity:delete_project(project_id=400b3bf1b5024f47844ec7e895cbc5d9)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:11.101389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:11.106598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1252/2493] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:11.115874 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53c64-3bfe-4814-9363-6028fc6aff80 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.116170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53c64-3bfe-4814-9363-6028fc6aff80 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.116455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53c64-3bfe-4814-9363-6028fc6aff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.134196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-96e53c64-3bfe-4814-9363-6028fc6aff80 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:11.135438 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-96e53c64-3bfe-4814-9363-6028fc6aff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:11.143451 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1253/2494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:11.147560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53c64-3bfe-4814-9363-6028fc6aff80 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:11.157102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53c64-3bfe-4814-9363-6028fc6aff80 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:11.161777 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:11.162445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.162767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.163045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.163770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:11.164076 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:11.165687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:11.177632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1254/2495] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:46:11.181742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:11.191276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d754dd-8384-481e-8cb8-601763bb4a35 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:11.196011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe138e-aee5-4bc3-8541-3646c59ceb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:11.196633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe138e-aee5-4bc3-8541-3646c59ceb36 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.196923 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe138e-aee5-4bc3-8541-3646c59ceb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.197220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe138e-aee5-4bc3-8541-3646c59ceb36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.197877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe138e-aee5-4bc3-8541-3646c59ceb36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:11.199779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe138e-aee5-4bc3-8541-3646c59ceb36 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:11.209292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400b3bf1b5024f47844ec7e895cbc5d9', 'request_id': 'req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:11.249761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400b3bf1b5024f47844ec7e895cbc5d9', 'request_id': 'req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:11.255198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400b3bf1b5024f47844ec7e895cbc5d9', 'request_id': 'req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:11.266334 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] The token cache is being invalidate because project 400b3bf1b5024f47844ec7e895cbc5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:11.266655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:11.267303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:11.268865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1242/2496] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:11 2022] DELETE /identity/v3/projects/400b3bf1b5024f47844ec7e895cbc5d9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:11.287352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1255/2497] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:11 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:11.291619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:11.293131 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:11.364319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f71bdb-9c65-4c53-a342-4f5ebd7becad admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:11.425828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e642c7-a12d-4bb5-92ca-7c44964f0df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:11.426425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e642c7-a12d-4bb5-92ca-7c44964f0df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.426764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e642c7-a12d-4bb5-92ca-7c44964f0df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.427048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e642c7-a12d-4bb5-92ca-7c44964f0df9 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.427761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e642c7-a12d-4bb5-92ca-7c44964f0df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:11.429745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e642c7-a12d-4bb5-92ca-7c44964f0df9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:11.536046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1243/2498] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:11 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:11.540141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe138e-aee5-4bc3-8541-3646c59ceb36 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:11.550799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe138e-aee5-4bc3-8541-3646c59ceb36 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:11.555575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fa3a0-019f-484d-8d80-76f2054b1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:11.556234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fa3a0-019f-484d-8d80-76f2054b1e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.556524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fa3a0-019f-484d-8d80-76f2054b1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.556806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fa3a0-019f-484d-8d80-76f2054b1e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.557660 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fa3a0-019f-484d-8d80-76f2054b1e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:11.559306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fa3a0-019f-484d-8d80-76f2054b1e5e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:11.574462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1256/2499] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:11.578386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e642c7-a12d-4bb5-92ca-7c44964f0df9 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:11.588517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e642c7-a12d-4bb5-92ca-7c44964f0df9 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:11.593228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af0a18-bb62-4855-96a0-c9e64ae12667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:11.593885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0a18-bb62-4855-96a0-c9e64ae12667 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.594172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0a18-bb62-4855-96a0-c9e64ae12667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.594450 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0a18-bb62-4855-96a0-c9e64ae12667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.595217 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af0a18-bb62-4855-96a0-c9e64ae12667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:11.596808 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af0a18-bb62-4855-96a0-c9e64ae12667 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:11.606480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1244/2500] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:11.610959 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fa3a0-019f-484d-8d80-76f2054b1e5e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:11.620902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fa3a0-019f-484d-8d80-76f2054b1e5e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:11.626111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99022b2e-1d73-4176-8c42-088b179186eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:11.627011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022b2e-1d73-4176-8c42-088b179186eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.627302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022b2e-1d73-4176-8c42-088b179186eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.627584 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99022b2e-1d73-4176-8c42-088b179186eb admin admin] PATH_INFO: `/v3/projects/a9433cf352124ba69725f55efd7901a3/users/8f384b51af18454095df3bf42f704cf0/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.641654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99022b2e-1d73-4176-8c42-088b179186eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9433cf352124ba69725f55efd7901a3, user_id=8f384b51af18454095df3bf42f704cf0, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:11.644368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99022b2e-1d73-4176-8c42-088b179186eb admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:11.741854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1257/2501] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:11 2022] PUT /identity/v3/projects/a9433cf352124ba69725f55efd7901a3/users/8f384b51af18454095df3bf42f704cf0/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:11.752340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f830e-aedb-43d6-9739-729ace1f0175 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.752695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f830e-aedb-43d6-9739-729ace1f0175 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.752982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f830e-aedb-43d6-9739-729ace1f0175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.780470 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-626f830e-aedb-43d6-9739-729ace1f0175 None None] MFA Rules not processed for user `8f384b51af18454095df3bf42f704cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:11.782359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-626f830e-aedb-43d6-9739-729ace1f0175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:11.847355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1245/2502] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:11.851773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99022b2e-1d73-4176-8c42-088b179186eb admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:11.911409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99022b2e-1d73-4176-8c42-088b179186eb admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:11.916052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eaf2d-7303-4d15-9b19-dc862ddef391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:11.916701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eaf2d-7303-4d15-9b19-dc862ddef391 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:11.916987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eaf2d-7303-4d15-9b19-dc862ddef391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:11.917264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eaf2d-7303-4d15-9b19-dc862ddef391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:11.917945 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eaf2d-7303-4d15-9b19-dc862ddef391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:11.919883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eaf2d-7303-4d15-9b19-dc862ddef391 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:12.005881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1258/2503] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:11 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:12.009756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f830e-aedb-43d6-9739-729ace1f0175 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:12.020435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f830e-aedb-43d6-9739-729ace1f0175 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:12.078778 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355fbdb-1e10-401b-a37a-07e96b3ec718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:12.079452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355fbdb-1e10-401b-a37a-07e96b3ec718 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:12.079734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355fbdb-1e10-401b-a37a-07e96b3ec718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:12.080038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355fbdb-1e10-401b-a37a-07e96b3ec718 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:12.080754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355fbdb-1e10-401b-a37a-07e96b3ec718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:12.082825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355fbdb-1e10-401b-a37a-07e96b3ec718 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:12.155243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1246/2504] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:12 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:12.157889 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eaf2d-7303-4d15-9b19-dc862ddef391 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:12.168410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eaf2d-7303-4d15-9b19-dc862ddef391 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:12.173363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb4d8f-1fe2-49c0-93af-64afee57609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:12.174080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb4d8f-1fe2-49c0-93af-64afee57609e admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:12.174366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb4d8f-1fe2-49c0-93af-64afee57609e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:12.174691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb4d8f-1fe2-49c0-93af-64afee57609e admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:12.175450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb4d8f-1fe2-49c0-93af-64afee57609e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:12.177057 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb4d8f-1fe2-49c0-93af-64afee57609e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:12.187733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1259/2505] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:12.192104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355fbdb-1e10-401b-a37a-07e96b3ec718 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:12.201871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355fbdb-1e10-401b-a37a-07e96b3ec718 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:12.207067 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300059-a610-4457-8ec1-fef3b56ba333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:12.207952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300059-a610-4457-8ec1-fef3b56ba333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:12.208238 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300059-a610-4457-8ec1-fef3b56ba333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:12.208517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300059-a610-4457-8ec1-fef3b56ba333 admin admin] PATH_INFO: `/v3/projects/11f207ad740b46729ebe1323a75d3474/users/2dfbc9ab04fe4005804c23f8f430f1e9/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:12.223323 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300059-a610-4457-8ec1-fef3b56ba333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f207ad740b46729ebe1323a75d3474, user_id=2dfbc9ab04fe4005804c23f8f430f1e9, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:12.225985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300059-a610-4457-8ec1-fef3b56ba333 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:12.278676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1247/2506] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:12 2022] PUT /identity/v3/projects/11f207ad740b46729ebe1323a75d3474/users/2dfbc9ab04fe4005804c23f8f430f1e9/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:12.283340 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb4d8f-1fe2-49c0-93af-64afee57609e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:12.293408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb4d8f-1fe2-49c0-93af-64afee57609e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:12.349766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797bea3-33b5-4e83-b316-e8a782f4f9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:12.350434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797bea3-33b5-4e83-b316-e8a782f4f9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:12.350747 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797bea3-33b5-4e83-b316-e8a782f4f9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:12.351027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797bea3-33b5-4e83-b316-e8a782f4f9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:12.351751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797bea3-33b5-4e83-b316-e8a782f4f9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:12.353354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797bea3-33b5-4e83-b316-e8a782f4f9d9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:12.363166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1260/2507] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:12.367434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300059-a610-4457-8ec1-fef3b56ba333 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:12.377942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300059-a610-4457-8ec1-fef3b56ba333 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:12.383026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:12.383924 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:12.384210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:12.384491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] PATH_INFO: `/v3/projects/11f207ad740b46729ebe1323a75d3474/users/2dfbc9ab04fe4005804c23f8f430f1e9/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:12.386521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f207ad740b46729ebe1323a75d3474, user_id=2dfbc9ab04fe4005804c23f8f430f1e9, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:12.389290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:12.400010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1248/2508] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:12 2022] PUT /identity/v3/projects/11f207ad740b46729ebe1323a75d3474/users/2dfbc9ab04fe4005804c23f8f430f1e9/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:12.411432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f536b-0a40-4b36-9667-3efeeba9d91e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:12.411728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f536b-0a40-4b36-9667-3efeeba9d91e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:12.412009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f536b-0a40-4b36-9667-3efeeba9d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:12.438200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-7c8f536b-0a40-4b36-9667-3efeeba9d91e None None] MFA Rules not processed for user `2dfbc9ab04fe4005804c23f8f430f1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:12.439595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-7c8f536b-0a40-4b36-9667-3efeeba9d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:12.536892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1261/2509] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:12.545614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:12.547926 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:12.614005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b677ac1-4062-45fb-8658-e6848175b100 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:12.617853 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de15e6-043b-43fd-b5cd-3bcf8bfb3a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:12.618508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de15e6-043b-43fd-b5cd-3bcf8bfb3a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:12.618824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de15e6-043b-43fd-b5cd-3bcf8bfb3a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:12.619101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de15e6-043b-43fd-b5cd-3bcf8bfb3a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:12.631974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de15e6-043b-43fd-b5cd-3bcf8bfb3a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:12.633495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de15e6-043b-43fd-b5cd-3bcf8bfb3a27 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:12.644515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1249/2510] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:46:13.601539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f536b-0a40-4b36-9667-3efeeba9d91e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:13.662813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f536b-0a40-4b36-9667-3efeeba9d91e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:13.667366 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:13.668225 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:13.668514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:13.668792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] PATH_INFO: `/v3/users/8f384b51af18454095df3bf42f704cf0` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:13.669989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f384b51af18454095df3bf42f704cf0)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:13.672004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:13.834309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f384b51af18454095df3bf42f704cf0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:13.841095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f384b51af18454095df3bf42f704cf0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:13.841779 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f384b51af18454095df3bf42f704cf0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:13.842471 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f384b51af18454095df3bf42f704cf0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:13.889570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f384b51af18454095df3bf42f704cf0'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:13.907930 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1262/2511] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:13 2022] DELETE /identity/v3/users/8f384b51af18454095df3bf42f704cf0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:13.912491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727d7a-e3f8-4148-b3c3-418c38332ee2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:13.913001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727d7a-e3f8-4148-b3c3-418c38332ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:13.913107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727d7a-e3f8-4148-b3c3-418c38332ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:13.930313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b9727d7a-e3f8-4148-b3c3-418c38332ee2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:13.931547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b9727d7a-e3f8-4148-b3c3-418c38332ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:13.988054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1250/2512] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:13.998098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:14.000160 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:14.057460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415606-53db-4caa-a2e1-8855a872dd6f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:14.061170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:14.062658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:14.062658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:14.062878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:14.071861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:14.074170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:14.082683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1263/2513] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:46:14.208318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b2b89-e2b2-43cf-b63e-ac34e089f4e8 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:14.208605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b2b89-e2b2-43cf-b63e-ac34e089f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:14.208887 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b2b89-e2b2-43cf-b63e-ac34e089f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:14.227908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-902b2b89-e2b2-43cf-b63e-ac34e089f4e8 None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:14.229110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-902b2b89-e2b2-43cf-b63e-ac34e089f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:14.289566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1251/2514] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:46:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:14.311665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:14.313392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:14.382093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4693105-427a-442d-ab39-2cb5a57da8d5 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:14.387414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc3bb-2d23-4d5a-a629-6a4421cd5518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:14.388073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc3bb-2d23-4d5a-a629-6a4421cd5518 service swift] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:14.388389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc3bb-2d23-4d5a-a629-6a4421cd5518 service swift] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:14.388734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddc3bb-2d23-4d5a-a629-6a4421cd5518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:14.397496 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddc3bb-2d23-4d5a-a629-6a4421cd5518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:14.399135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddc3bb-2d23-4d5a-a629-6a4421cd5518 service swift] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:14.408514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1264/2515] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:46:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:46:14.480325 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b2b89-e2b2-43cf-b63e-ac34e089f4e8 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:14.481759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-902b2b89-e2b2-43cf-b63e-ac34e089f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:14.498380 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b2b89-e2b2-43cf-b63e-ac34e089f4e8 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:14.504097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:14.505163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:14.505440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:14.505712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] PATH_INFO: `/v3/projects/a9433cf352124ba69725f55efd7901a3` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:14.506985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9433cf352124ba69725f55efd7901a3)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:14.508824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:14.650779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9433cf352124ba69725f55efd7901a3', 'request_id': 'req-1c42f529-fce6-4efa-af45-011c08d9738d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:14.724269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9433cf352124ba69725f55efd7901a3', 'request_id': 'req-1c42f529-fce6-4efa-af45-011c08d9738d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:14.730357 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9433cf352124ba69725f55efd7901a3', 'request_id': 'req-1c42f529-fce6-4efa-af45-011c08d9738d'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:14.741902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] The token cache is being invalidate because project a9433cf352124ba69725f55efd7901a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:14.742189 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:14.742837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1c42f529-fce6-4efa-af45-011c08d9738d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:14.744922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1252/2516] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:14 2022] DELETE /identity/v3/projects/a9433cf352124ba69725f55efd7901a3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:14.748671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc3bb-2d23-4d5a-a629-6a4421cd5518 service swift] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:14.759078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddc3bb-2d23-4d5a-a629-6a4421cd5518 service swift] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:14.821229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:14.822102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:14.822389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:14.822716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] PATH_INFO: `/v3/users/2dfbc9ab04fe4005804c23f8f430f1e9` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:14.823948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfbc9ab04fe4005804c23f8f430f1e9)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:14.825964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:15.037091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfbc9ab04fe4005804c23f8f430f1e9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.048270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfbc9ab04fe4005804c23f8f430f1e9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.049454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfbc9ab04fe4005804c23f8f430f1e9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.050162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfbc9ab04fe4005804c23f8f430f1e9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.112665 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfbc9ab04fe4005804c23f8f430f1e9'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.133689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1265/2517] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:14 2022] DELETE /identity/v3/users/2dfbc9ab04fe4005804c23f8f430f1e9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:15.308414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ec1d-b6f9-4bf8-9876-c9975487716b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:15.308891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ec1d-b6f9-4bf8-9876-c9975487716b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:15.308990 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32ec1d-b6f9-4bf8-9876-c9975487716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:15.327039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3d32ec1d-b6f9-4bf8-9876-c9975487716b None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:15.328871 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3d32ec1d-b6f9-4bf8-9876-c9975487716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:15.387813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1253/2518] 10.222.0.43 () {58 vars in 967 bytes} [Thu Apr 28 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:15.400881 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:15.403234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:15.472218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082690c-25e4-43a8-96bb-74947a099394 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:15.477303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4feb2-901e-4b97-b617-96e2315323b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:15.477952 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4feb2-901e-4b97-b617-96e2315323b3 service swift] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:15.478243 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4feb2-901e-4b97-b617-96e2315323b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:15.478524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4feb2-901e-4b97-b617-96e2315323b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:15.486754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4feb2-901e-4b97-b617-96e2315323b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:15.488287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4feb2-901e-4b97-b617-96e2315323b3 service swift] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:15.496364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1266/2519] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:46:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:46:15.554101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32ec1d-b6f9-4bf8-9876-c9975487716b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:15.555662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3d32ec1d-b6f9-4bf8-9876-c9975487716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:15.623713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32ec1d-b6f9-4bf8-9876-c9975487716b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:15.628823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:15.629725 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:15.630010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:15.630306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] PATH_INFO: `/v3/projects/11f207ad740b46729ebe1323a75d3474` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:15.631686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f207ad740b46729ebe1323a75d3474)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:15.633620 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:15.740621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f207ad740b46729ebe1323a75d3474', 'request_id': 'req-252ebb39-49da-4e8b-9f6b-df312eed2c9a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.820984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f207ad740b46729ebe1323a75d3474', 'request_id': 'req-252ebb39-49da-4e8b-9f6b-df312eed2c9a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.826907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f207ad740b46729ebe1323a75d3474', 'request_id': 'req-252ebb39-49da-4e8b-9f6b-df312eed2c9a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.838700 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] The token cache is being invalidate because project 11f207ad740b46729ebe1323a75d3474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:15.838992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.839667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-252ebb39-49da-4e8b-9f6b-df312eed2c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:15.841281 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1254/2520] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:15 2022] DELETE /identity/v3/projects/11f207ad740b46729ebe1323a75d3474 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:15.847108 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00192db-d128-4073-9871-6d436af1dae4 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:15.847618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00192db-d128-4073-9871-6d436af1dae4 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:15.847717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00192db-d128-4073-9871-6d436af1dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:15.865821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d00192db-d128-4073-9871-6d436af1dae4 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:15.867078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d00192db-d128-4073-9871-6d436af1dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:15.926520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1267/2521] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:15.935466 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1982c-55d5-4b61-9cca-25fd0a7d0881 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:15.935757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1982c-55d5-4b61-9cca-25fd0a7d0881 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:15.936062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1982c-55d5-4b61-9cca-25fd0a7d0881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:15.954928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-82c1982c-55d5-4b61-9cca-25fd0a7d0881 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:15.956195 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-82c1982c-55d5-4b61-9cca-25fd0a7d0881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:15.964355 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1255/2522] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:15.968628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00192db-d128-4073-9871-6d436af1dae4 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:15.978126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00192db-d128-4073-9871-6d436af1dae4 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:15.982800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875b258-14ca-48e6-961d-e4f3251922bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:15.983460 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875b258-14ca-48e6-961d-e4f3251922bf admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:15.984381 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875b258-14ca-48e6-961d-e4f3251922bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:15.985045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875b258-14ca-48e6-961d-e4f3251922bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:15.985246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875b258-14ca-48e6-961d-e4f3251922bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:15.985545 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875b258-14ca-48e6-961d-e4f3251922bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:15.987207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875b258-14ca-48e6-961d-e4f3251922bf admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:15.999287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1268/2523] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:46:16.004042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1982c-55d5-4b61-9cca-25fd0a7d0881 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:16.013718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1982c-55d5-4b61-9cca-25fd0a7d0881 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:16.018526 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0d9f-69f6-4ffc-98f0-1228de77dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:16.019216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0d9f-69f6-4ffc-98f0-1228de77dba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.019508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0d9f-69f6-4ffc-98f0-1228de77dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.019786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce0d9f-69f6-4ffc-98f0-1228de77dba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.020513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce0d9f-69f6-4ffc-98f0-1228de77dba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:16.022425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce0d9f-69f6-4ffc-98f0-1228de77dba6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:16.119717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d1f4-b756-4b95-b376-0fb16377168e None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.120015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d1f4-b756-4b95-b376-0fb16377168e None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.120297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d1f4-b756-4b95-b376-0fb16377168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.139640 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8556d1f4-b756-4b95-b376-0fb16377168e None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:16.141193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8556d1f4-b756-4b95-b376-0fb16377168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:16.153727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1256/2524] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:16 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:16.154786 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0d9f-69f6-4ffc-98f0-1228de77dba6 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:16.210239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1269/2525] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:16.223015 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d1f4-b756-4b95-b376-0fb16377168e None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:16.224597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8556d1f4-b756-4b95-b376-0fb16377168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:16.226897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce0d9f-69f6-4ffc-98f0-1228de77dba6 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:16.231819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac61c2-6016-4b8f-85e7-0d834bbe18a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:16.232498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac61c2-6016-4b8f-85e7-0d834bbe18a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.232785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac61c2-6016-4b8f-85e7-0d834bbe18a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.233065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac61c2-6016-4b8f-85e7-0d834bbe18a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.234382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac61c2-6016-4b8f-85e7-0d834bbe18a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:16.236416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac61c2-6016-4b8f-85e7-0d834bbe18a0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:16.299036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d1f4-b756-4b95-b376-0fb16377168e None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:16.361786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88828e-7409-4cf1-8bc8-27348afe1c99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:16.362521 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88828e-7409-4cf1-8bc8-27348afe1c99 service swift] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.362862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88828e-7409-4cf1-8bc8-27348afe1c99 service swift] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.363140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88828e-7409-4cf1-8bc8-27348afe1c99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.381183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1257/2526] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:16 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:16.385250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac61c2-6016-4b8f-85e7-0d834bbe18a0 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:16.395472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac61c2-6016-4b8f-85e7-0d834bbe18a0 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:16.400310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25bc5-74fa-43c7-9a2a-ce9fa3dedf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:16.400971 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25bc5-74fa-43c7-9a2a-ce9fa3dedf8f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.401259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25bc5-74fa-43c7-9a2a-ce9fa3dedf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.401567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25bc5-74fa-43c7-9a2a-ce9fa3dedf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.402328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff25bc5-74fa-43c7-9a2a-ce9fa3dedf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:16.404207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff25bc5-74fa-43c7-9a2a-ce9fa3dedf8f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:16.417636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1258/2527] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:16.417829 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88828e-7409-4cf1-8bc8-27348afe1c99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:16.418862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88828e-7409-4cf1-8bc8-27348afe1c99 service swift] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:16.419495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25bc5-74fa-43c7-9a2a-ce9fa3dedf8f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:16.427691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1270/2528] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:46:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 16:46:16.429794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25bc5-74fa-43c7-9a2a-ce9fa3dedf8f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:16.434834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c275-eba2-489d-b245-542185e38a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:16.435489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c275-eba2-489d-b245-542185e38a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.435773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c275-eba2-489d-b245-542185e38a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.436047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c275-eba2-489d-b245-542185e38a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.438648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c275-eba2-489d-b245-542185e38a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:16.441091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c275-eba2-489d-b245-542185e38a09 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:16.455124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1259/2529] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:16.459352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88828e-7409-4cf1-8bc8-27348afe1c99 service swift] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:16.470814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88828e-7409-4cf1-8bc8-27348afe1c99 service swift] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:16.475562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:16.476457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.476769 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.477050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] PATH_INFO: `/v3/projects/ce9dcd0e5ec34f7e919a7f5250ad691e/users/3ca5367552a24bd498379c0b0dd45ec4/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.493650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9dcd0e5ec34f7e919a7f5250ad691e, user_id=3ca5367552a24bd498379c0b0dd45ec4, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:16.496544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:16.564707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1271/2530] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:16 2022] PUT /identity/v3/projects/ce9dcd0e5ec34f7e919a7f5250ad691e/users/3ca5367552a24bd498379c0b0dd45ec4/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:16.575117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9296a4a-c4dd-4958-9374-b671b9816951 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.575403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9296a4a-c4dd-4958-9374-b671b9816951 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.575680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9296a4a-c4dd-4958-9374-b671b9816951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.602616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e9296a4a-c4dd-4958-9374-b671b9816951 None None] MFA Rules not processed for user `3ca5367552a24bd498379c0b0dd45ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:16.603833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e9296a4a-c4dd-4958-9374-b671b9816951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:16.671168 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1260/2531] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:16.682678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:16.684448 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:16.746845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1c10-d425-4a31-a911-e185b5f4aa62 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:16.750886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358aa43-1b3e-48b9-9b79-e9dec4d1495c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:16.751618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358aa43-1b3e-48b9-9b79-e9dec4d1495c service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.751980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358aa43-1b3e-48b9-9b79-e9dec4d1495c service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.752336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358aa43-1b3e-48b9-9b79-e9dec4d1495c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.762787 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358aa43-1b3e-48b9-9b79-e9dec4d1495c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:16.764333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358aa43-1b3e-48b9-9b79-e9dec4d1495c service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:16.774395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1272/2532] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:16.962016 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a149-166a-4087-9f34-1569c1026149 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:16.962318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a149-166a-4087-9f34-1569c1026149 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:16.964402 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a149-166a-4087-9f34-1569c1026149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:16.982327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-2018a149-166a-4087-9f34-1569c1026149 None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:16.983707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2018a149-166a-4087-9f34-1569c1026149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:17.048231 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1261/2533] 10.222.0.43 () {58 vars in 967 bytes} [Thu Apr 28 16:46:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:17.060760 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358aa43-1b3e-48b9-9b79-e9dec4d1495c service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:17.126920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358aa43-1b3e-48b9-9b79-e9dec4d1495c service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:17.132247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8aadd-9222-4466-aec7-e142a2953987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:17.132920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8aadd-9222-4466-aec7-e142a2953987 service swift] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:17.133211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8aadd-9222-4466-aec7-e142a2953987 service swift] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:17.133492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8aadd-9222-4466-aec7-e142a2953987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:17.142774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8aadd-9222-4466-aec7-e142a2953987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:17.144557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8aadd-9222-4466-aec7-e142a2953987 service swift] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:17.153478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1273/2534] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:46:19.959640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018a149-166a-4087-9f34-1569c1026149 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:19.961110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2018a149-166a-4087-9f34-1569c1026149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:20.044994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018a149-166a-4087-9f34-1569c1026149 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:20.051727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:20.052723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:20.053081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:20.053449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] PATH_INFO: `/v3/users/48d54457f1814de6851f47d153eb4014` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:20.054770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d54457f1814de6851f47d153eb4014)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:20.056791 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:20.281436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d54457f1814de6851f47d153eb4014'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:20.282202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d54457f1814de6851f47d153eb4014'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:20.289092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d54457f1814de6851f47d153eb4014'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:20.289842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d54457f1814de6851f47d153eb4014'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:20.358143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d54457f1814de6851f47d153eb4014'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:20.375587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1262/2535] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:19 2022] DELETE /identity/v3/users/48d54457f1814de6851f47d153eb4014 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:20.380078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f68f1-ef5e-47db-96bb-b3200777cb52 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:20.380577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f68f1-ef5e-47db-96bb-b3200777cb52 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:20.380672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f68f1-ef5e-47db-96bb-b3200777cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:20.399713 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-226f68f1-ef5e-47db-96bb-b3200777cb52 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:20.400933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-226f68f1-ef5e-47db-96bb-b3200777cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:20.467111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1274/2536] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:20.477033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:20.478426 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:20.538276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b40bda-c4ba-480e-a6a3-4d3d4e0c1b5e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:20.541891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:20.542555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:20.542863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:20.543140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:20.552170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:20.559019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:20.563075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1263/2537] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:20.768334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f68f1-ef5e-47db-96bb-b3200777cb52 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:20.769937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-226f68f1-ef5e-47db-96bb-b3200777cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:20.770075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:20.771540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:20.783929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f68f1-ef5e-47db-96bb-b3200777cb52 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:20.789219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:20.790098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:20.790581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:20.790892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] PATH_INFO: `/v3/projects/a763aed5d5244d5cbf5b30987a1d67ab` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:20.792132 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a763aed5d5244d5cbf5b30987a1d67ab)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:20.807508 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:20.808143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e35ac-fe5e-43dd-9d37-b0bff2b4843c service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:20.808143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:20.808143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:20.808143 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:20.808914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] PATH_INFO: `/v3/users/3ca5367552a24bd498379c0b0dd45ec4` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:20.808914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca5367552a24bd498379c0b0dd45ec4)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:20.808914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:20.941232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a763aed5d5244d5cbf5b30987a1d67ab', 'request_id': 'req-20d26470-f28d-438f-8bc2-e58921912139'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.010007 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a763aed5d5244d5cbf5b30987a1d67ab', 'request_id': 'req-20d26470-f28d-438f-8bc2-e58921912139'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.016818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a763aed5d5244d5cbf5b30987a1d67ab', 'request_id': 'req-20d26470-f28d-438f-8bc2-e58921912139'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.028085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] The token cache is being invalidate because project a763aed5d5244d5cbf5b30987a1d67ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:21.028374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.029008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-20d26470-f28d-438f-8bc2-e58921912139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.030612 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1275/2538] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:20 2022] DELETE /identity/v3/projects/a763aed5d5244d5cbf5b30987a1d67ab => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:21.035739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dea79-844b-4884-8dc2-8927ca81aa0d None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.036023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dea79-844b-4884-8dc2-8927ca81aa0d None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.036303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dea79-844b-4884-8dc2-8927ca81aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.048316 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca5367552a24bd498379c0b0dd45ec4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.050165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca5367552a24bd498379c0b0dd45ec4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.056389 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-df7dea79-844b-4884-8dc2-8927ca81aa0d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:21.057654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-df7dea79-844b-4884-8dc2-8927ca81aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:21.057775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca5367552a24bd498379c0b0dd45ec4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.058484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca5367552a24bd498379c0b0dd45ec4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.116293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1276/2539] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:21.123871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b5d8f-196c-4e19-bed3-055f29a91d20 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.124824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b5d8f-196c-4e19-bed3-055f29a91d20 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.125107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b5d8f-196c-4e19-bed3-055f29a91d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.140939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-84f0c39c-923e-49a9-9853-106cb01e3e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca5367552a24bd498379c0b0dd45ec4'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.144542 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f90b5d8f-196c-4e19-bed3-055f29a91d20 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:21.145823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f90b5d8f-196c-4e19-bed3-055f29a91d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:21.154590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1277/2540] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:21.158683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b5d8f-196c-4e19-bed3-055f29a91d20 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.160727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1264/2541] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:20 2022] DELETE /identity/v3/users/3ca5367552a24bd498379c0b0dd45ec4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:21.164903 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7c38-44ae-485e-8b64-ec04bd9e780d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.165270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7c38-44ae-485e-8b64-ec04bd9e780d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.165567 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7c38-44ae-485e-8b64-ec04bd9e780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.167845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b5d8f-196c-4e19-bed3-055f29a91d20 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.183419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-4dbe7c38-44ae-485e-8b64-ec04bd9e780d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:21.184629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4dbe7c38-44ae-485e-8b64-ec04bd9e780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:21.223593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.224187 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.224482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.224766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.225529 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:21.225837 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:21.227487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:21.239570 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1278/2542] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:46:21.243606 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1265/2543] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:21.243759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.252842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7c38-44ae-485e-8b64-ec04bd9e780d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.253555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23d3b-6539-49ef-8c2a-61ac53ae6562 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.254188 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4dbe7c38-44ae-485e-8b64-ec04bd9e780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:21.258199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a807-2b5f-415f-a4c6-a23fadffde70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.258947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a807-2b5f-415f-a4c6-a23fadffde70 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.259236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a807-2b5f-415f-a4c6-a23fadffde70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.259516 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685a807-2b5f-415f-a4c6-a23fadffde70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.260211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685a807-2b5f-415f-a4c6-a23fadffde70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:21.262113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685a807-2b5f-415f-a4c6-a23fadffde70 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:21.311434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7c38-44ae-485e-8b64-ec04bd9e780d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.315839 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca0938-bb5a-4037-a8e5-40a969495a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.316489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0938-bb5a-4037-a8e5-40a969495a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.316782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0938-bb5a-4037-a8e5-40a969495a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.317065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0938-bb5a-4037-a8e5-40a969495a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.326152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca0938-bb5a-4037-a8e5-40a969495a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:21.327728 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca0938-bb5a-4037-a8e5-40a969495a10 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:21.336946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1266/2544] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:21.381080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1279/2545] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:21 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:21.382265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca0938-bb5a-4037-a8e5-40a969495a10 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.392475 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca0938-bb5a-4037-a8e5-40a969495a10 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.450917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6f6a7-3952-4870-9150-3c23aa1bef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.451593 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f6a7-3952-4870-9150-3c23aa1bef5f admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.451885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f6a7-3952-4870-9150-3c23aa1bef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.452214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6f6a7-3952-4870-9150-3c23aa1bef5f admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.452921 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6f6a7-3952-4870-9150-3c23aa1bef5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:21.454873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6f6a7-3952-4870-9150-3c23aa1bef5f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:21.542951 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1267/2546] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:21 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:21.547487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a807-2b5f-415f-a4c6-a23fadffde70 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.557890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685a807-2b5f-415f-a4c6-a23fadffde70 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.562875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f97be-f849-48d9-a2bb-d48218b1f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.563615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f97be-f849-48d9-a2bb-d48218b1f190 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.563909 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f97be-f849-48d9-a2bb-d48218b1f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.564187 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f97be-f849-48d9-a2bb-d48218b1f190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.564914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f97be-f849-48d9-a2bb-d48218b1f190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:21.566518 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f97be-f849-48d9-a2bb-d48218b1f190 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:21.576514 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1280/2547] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:21.580482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6f6a7-3952-4870-9150-3c23aa1bef5f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.590287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6f6a7-3952-4870-9150-3c23aa1bef5f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.596030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.596706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.596998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.597313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.600199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:21.600199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:21.614443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1268/2548] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:21.615823 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f97be-f849-48d9-a2bb-d48218b1f190 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.625708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f97be-f849-48d9-a2bb-d48218b1f190 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.630449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d19dd7-b9b4-4e2f-a3f1-e82bd6c54c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.631368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19dd7-b9b4-4e2f-a3f1-e82bd6c54c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.631659 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19dd7-b9b4-4e2f-a3f1-e82bd6c54c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.631946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d19dd7-b9b4-4e2f-a3f1-e82bd6c54c82 admin admin] PATH_INFO: `/v3/projects/5b57d30a3fb342e9b6b8b0bde1243152/users/43a9ff63594f4effb78d50e2f7b5645b/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.646503 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d19dd7-b9b4-4e2f-a3f1-e82bd6c54c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b57d30a3fb342e9b6b8b0bde1243152, user_id=43a9ff63594f4effb78d50e2f7b5645b, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:21.651762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d19dd7-b9b4-4e2f-a3f1-e82bd6c54c82 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:21.709272 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.712094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:21.725647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6413149-48a0-4204-83bf-99d879548ace admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.731789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.732879 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.733166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.733479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] PATH_INFO: `/v3/projects/ce9dcd0e5ec34f7e919a7f5250ad691e` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.735611 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9dcd0e5ec34f7e919a7f5250ad691e)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:21.741326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:21.741577 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1281/2549] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:21 2022] PUT /identity/v3/projects/5b57d30a3fb342e9b6b8b0bde1243152/users/43a9ff63594f4effb78d50e2f7b5645b/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:21.751732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d75e2-c7b6-4463-9bff-42a9a249b816 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.752034 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d75e2-c7b6-4463-9bff-42a9a249b816 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.752363 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d75e2-c7b6-4463-9bff-42a9a249b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.785377 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-742d75e2-c7b6-4463-9bff-42a9a249b816 None None] MFA Rules not processed for user `43a9ff63594f4effb78d50e2f7b5645b`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:21.786647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-742d75e2-c7b6-4463-9bff-42a9a249b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:21.844609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9dcd0e5ec34f7e919a7f5250ad691e', 'request_id': 'req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.854763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1282/2550] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:21.866133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d75e2-c7b6-4463-9bff-42a9a249b816 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:21.867553 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-742d75e2-c7b6-4463-9bff-42a9a249b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:21.918145 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9dcd0e5ec34f7e919a7f5250ad691e', 'request_id': 'req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.923754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d75e2-c7b6-4463-9bff-42a9a249b816 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:21.924085 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9dcd0e5ec34f7e919a7f5250ad691e', 'request_id': 'req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.935693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] The token cache is being invalidate because project ce9dcd0e5ec34f7e919a7f5250ad691e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:21.935985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.936696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6aab0e1f-5f57-45ed-947c-41c6785e2d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:21.938262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1269/2551] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:21 2022] DELETE /identity/v3/projects/ce9dcd0e5ec34f7e919a7f5250ad691e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:21.942931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ab68-e21d-4156-a51c-549b7113f867 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.943220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ab68-e21d-4156-a51c-549b7113f867 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.943497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ab68-e21d-4156-a51c-549b7113f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.961042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-a176ab68-e21d-4156-a51c-549b7113f867 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:21.962274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a176ab68-e21d-4156-a51c-549b7113f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:21.974564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:21.978177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:21.978177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:21.978177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:21.978177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:22.029073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1270/2552] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:22.037411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37477589-c77a-49a6-a811-b2aa9d0d4e4a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.037792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37477589-c77a-49a6-a811-b2aa9d0d4e4a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.038079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37477589-c77a-49a6-a811-b2aa9d0d4e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.041421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:22.043119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:22.054519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1283/2553] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:46:22.057910 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-37477589-c77a-49a6-a811-b2aa9d0d4e4a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:22.059128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-37477589-c77a-49a6-a811-b2aa9d0d4e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:22.067618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1271/2554] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:22.072066 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:22.083905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12c29e-2e77-4fdb-9c59-f83b23c01b8e service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:22.088989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:22.089706 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.090069 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.090350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.091110 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:22.091421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:22.093061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:22.105732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1284/2555] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:46:22.110022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37477589-c77a-49a6-a811-b2aa9d0d4e4a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:22.119245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37477589-c77a-49a6-a811-b2aa9d0d4e4a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:22.124019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c11584-81e5-4727-b8a3-b2ee7bcbc334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:22.124715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c11584-81e5-4727-b8a3-b2ee7bcbc334 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.125127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c11584-81e5-4727-b8a3-b2ee7bcbc334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.125414 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c11584-81e5-4727-b8a3-b2ee7bcbc334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.126116 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c11584-81e5-4727-b8a3-b2ee7bcbc334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:22.128031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c11584-81e5-4727-b8a3-b2ee7bcbc334 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:22.203888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1272/2556] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:22 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:22.205031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:22.215273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bd97f-8513-47cf-a49c-32ccccf643c1 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:22.272844 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e02330-6248-48a6-9b36-b33d40dd754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:22.273512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02330-6248-48a6-9b36-b33d40dd754c admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.273831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02330-6248-48a6-9b36-b33d40dd754c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.274070 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02330-6248-48a6-9b36-b33d40dd754c admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.274783 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e02330-6248-48a6-9b36-b33d40dd754c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:22.276700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e02330-6248-48a6-9b36-b33d40dd754c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:22.370148 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1285/2557] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:22 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:22.373994 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c11584-81e5-4727-b8a3-b2ee7bcbc334 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:22.384234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c11584-81e5-4727-b8a3-b2ee7bcbc334 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:22.389160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a488138-d0aa-495a-ba4e-76665b666788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:22.389857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488138-d0aa-495a-ba4e-76665b666788 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.390127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488138-d0aa-495a-ba4e-76665b666788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.390406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488138-d0aa-495a-ba4e-76665b666788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.391188 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a488138-d0aa-495a-ba4e-76665b666788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:22.392810 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a488138-d0aa-495a-ba4e-76665b666788 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:22.406922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1273/2558] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:22.408543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e02330-6248-48a6-9b36-b33d40dd754c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:22.418488 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e02330-6248-48a6-9b36-b33d40dd754c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:22.423776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3af411-ac1f-4f78-afcb-57e8588817f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:22.424431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af411-ac1f-4f78-afcb-57e8588817f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.424721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af411-ac1f-4f78-afcb-57e8588817f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.425009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af411-ac1f-4f78-afcb-57e8588817f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.425741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3af411-ac1f-4f78-afcb-57e8588817f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:22.427378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3af411-ac1f-4f78-afcb-57e8588817f7 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:22.437109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1286/2559] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:22.441240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a488138-d0aa-495a-ba4e-76665b666788 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:22.450992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a488138-d0aa-495a-ba4e-76665b666788 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:22.455519 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:22.456405 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.456688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.456977 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] PATH_INFO: `/v3/projects/1fdc3eb31c304e1aac6eba64b2b649a8/users/1869308fc60842eeadf47f67493a6660/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.471369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdc3eb31c304e1aac6eba64b2b649a8, user_id=1869308fc60842eeadf47f67493a6660, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:22.474008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:22.581897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1274/2560] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:22 2022] PUT /identity/v3/projects/1fdc3eb31c304e1aac6eba64b2b649a8/users/1869308fc60842eeadf47f67493a6660/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:22.593372 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32158-ae3e-4f34-abef-e51a5aadc8d5 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.594239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32158-ae3e-4f34-abef-e51a5aadc8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.594523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a32158-ae3e-4f34-abef-e51a5aadc8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.621153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-33a32158-ae3e-4f34-abef-e51a5aadc8d5 None None] MFA Rules not processed for user `1869308fc60842eeadf47f67493a6660`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:22.622391 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-33a32158-ae3e-4f34-abef-e51a5aadc8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:22.688646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1287/2561] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:22.700247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:22.703271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:22.757619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc237bb-50f3-4c95-9e60-07fb0d6e60bb admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:22.761356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:22.762005 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:22.762295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:22.762636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:22.771445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:22.772870 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:22.782423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1275/2562] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:23.119704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a32158-ae3e-4f34-abef-e51a5aadc8d5 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:23.121129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-33a32158-ae3e-4f34-abef-e51a5aadc8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:23.183501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a32158-ae3e-4f34-abef-e51a5aadc8d5 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:23.187081 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:23.188240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:23.188524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:23.188797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:23.190643 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:23.251087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:23.252546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:23.262229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1288/2563] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:27.003922 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:27.005827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:27.021394 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1922ea-ecbd-4870-ad7a-05b5f7ddd922 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:27.026103 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:27.027172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:27.027712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:27.028056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] PATH_INFO: `/v3/users/945ab009e1024a199a324e9c4941e8fe` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:27.029250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] RBAC: Authorizing `identity:delete_user(user_id=945ab009e1024a199a324e9c4941e8fe)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:27.031210 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:27.233833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945ab009e1024a199a324e9c4941e8fe'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.235030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945ab009e1024a199a324e9c4941e8fe'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.241602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945ab009e1024a199a324e9c4941e8fe'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.242234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945ab009e1024a199a324e9c4941e8fe'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.301051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-c4aa8ba7-2156-42b1-a5a5-49db69fcadef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945ab009e1024a199a324e9c4941e8fe'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.319556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1276/2564] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:27 2022] DELETE /identity/v3/users/945ab009e1024a199a324e9c4941e8fe => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:27.561536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:27.572623 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbec614-1068-4287-8791-b687ea0e500f service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:27.632447 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:27.633320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:27.633605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:27.633890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] PATH_INFO: `/v3/projects/42da459950064ee2bed6cba97ed9986d` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:27.635146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=42da459950064ee2bed6cba97ed9986d)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:27.638604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:27.736115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42da459950064ee2bed6cba97ed9986d', 'request_id': 'req-f73a0d81-9fa5-4043-beff-b7145a3db48a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.837886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42da459950064ee2bed6cba97ed9986d', 'request_id': 'req-f73a0d81-9fa5-4043-beff-b7145a3db48a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.844692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42da459950064ee2bed6cba97ed9986d', 'request_id': 'req-f73a0d81-9fa5-4043-beff-b7145a3db48a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.855676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] The token cache is being invalidate because project 42da459950064ee2bed6cba97ed9986d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:27.855965 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.856639 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f73a0d81-9fa5-4043-beff-b7145a3db48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:27.859199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1289/2565] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:27 2022] DELETE /identity/v3/projects/42da459950064ee2bed6cba97ed9986d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:27.863202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595273d-6ef5-4b1a-9937-9dad05c6948c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:27.863482 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595273d-6ef5-4b1a-9937-9dad05c6948c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:27.863832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595273d-6ef5-4b1a-9937-9dad05c6948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:27.881216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9595273d-6ef5-4b1a-9937-9dad05c6948c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:27.882488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9595273d-6ef5-4b1a-9937-9dad05c6948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:27.946065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1277/2566] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:27.954941 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3ca1-75f1-4047-b667-54e2bb6f1795 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:27.955231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3ca1-75f1-4047-b667-54e2bb6f1795 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:27.955512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb3ca1-75f1-4047-b667-54e2bb6f1795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:27.974312 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-cdeb3ca1-75f1-4047-b667-54e2bb6f1795 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:27.975625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cdeb3ca1-75f1-4047-b667-54e2bb6f1795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:27.983487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1290/2567] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:27.987573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595273d-6ef5-4b1a-9937-9dad05c6948c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:27.997263 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595273d-6ef5-4b1a-9937-9dad05c6948c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:28.001885 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:28.002605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.002892 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.003167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.003894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:28.004203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:28.005787 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:28.017864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1278/2568] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:46:28.022101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb3ca1-75f1-4047-b667-54e2bb6f1795 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:28.031989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb3ca1-75f1-4047-b667-54e2bb6f1795 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:28.036702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029c00b-fe94-4c02-9434-d0d50119e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:28.037350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029c00b-fe94-4c02-9434-d0d50119e9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.037633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029c00b-fe94-4c02-9434-d0d50119e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.037910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029c00b-fe94-4c02-9434-d0d50119e9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.038656 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029c00b-fe94-4c02-9434-d0d50119e9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:28.041654 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029c00b-fe94-4c02-9434-d0d50119e9a9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:28.130966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1291/2569] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:28 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:28.135107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:28.145980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514e23-8e1f-4258-867e-aad02273dbe8 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:28.200865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490272c8-cf3c-438b-8ccb-b7f86a57741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:28.201538 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490272c8-cf3c-438b-8ccb-b7f86a57741c admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.201842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490272c8-cf3c-438b-8ccb-b7f86a57741c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.202123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490272c8-cf3c-438b-8ccb-b7f86a57741c admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.203477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490272c8-cf3c-438b-8ccb-b7f86a57741c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:28.205392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490272c8-cf3c-438b-8ccb-b7f86a57741c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:28.295351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1279/2570] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:28 2022] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:28.299352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029c00b-fe94-4c02-9434-d0d50119e9a9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:28.309562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029c00b-fe94-4c02-9434-d0d50119e9a9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:28.314878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcbc4b-2962-42de-9884-fa589c37a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:28.315524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcbc4b-2962-42de-9884-fa589c37a817 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.316039 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcbc4b-2962-42de-9884-fa589c37a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.316905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcbc4b-2962-42de-9884-fa589c37a817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.317061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcbc4b-2962-42de-9884-fa589c37a817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:28.318770 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcbc4b-2962-42de-9884-fa589c37a817 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:28.330294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1292/2571] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:28.334198 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490272c8-cf3c-438b-8ccb-b7f86a57741c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:28.344667 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490272c8-cf3c-438b-8ccb-b7f86a57741c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:28.349458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8636b-649d-4008-8269-d09e1b24216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:28.350130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8636b-649d-4008-8269-d09e1b24216f admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.351064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8636b-649d-4008-8269-d09e1b24216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.351064 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8636b-649d-4008-8269-d09e1b24216f admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.351623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8636b-649d-4008-8269-d09e1b24216f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:28.353226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8636b-649d-4008-8269-d09e1b24216f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:28.363719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1280/2572] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:28.367723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcbc4b-2962-42de-9884-fa589c37a817 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:28.379349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcbc4b-2962-42de-9884-fa589c37a817 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:28.384523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:28.385420 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.385809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.386078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] PATH_INFO: `/v3/projects/9ca50eeeee404600a8b5981bedbfa545/users/663a6375cf9f47d0b7b0c5a12e3c7195/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.402993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca50eeeee404600a8b5981bedbfa545, user_id=663a6375cf9f47d0b7b0c5a12e3c7195, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:28.405534 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:28.460376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1293/2573] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:28 2022] PUT /identity/v3/projects/9ca50eeeee404600a8b5981bedbfa545/users/663a6375cf9f47d0b7b0c5a12e3c7195/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:28.465510 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7e3cd-97b1-4a3b-a248-7dc1e72c6d88 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.465820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7e3cd-97b1-4a3b-a248-7dc1e72c6d88 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.466169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7e3cd-97b1-4a3b-a248-7dc1e72c6d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.484026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b1d7e3cd-97b1-4a3b-a248-7dc1e72c6d88 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:28.485241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b1d7e3cd-97b1-4a3b-a248-7dc1e72c6d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:28.542455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1281/2574] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:28.552081 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:28.553796 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:28.611049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79773b18-e5e5-4e8b-ab4f-04b258820f02 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:28.614810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25764a5-45ac-441e-ac5a-d429afcd9edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:28.615446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25764a5-45ac-441e-ac5a-d429afcd9edb service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.615731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25764a5-45ac-441e-ac5a-d429afcd9edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.616008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25764a5-45ac-441e-ac5a-d429afcd9edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.625955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25764a5-45ac-441e-ac5a-d429afcd9edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:28.627444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25764a5-45ac-441e-ac5a-d429afcd9edb service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:28.637385 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1294/2575] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:46:28.926324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7e3cd-97b1-4a3b-a248-7dc1e72c6d88 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:28.928535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b1d7e3cd-97b1-4a3b-a248-7dc1e72c6d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:28.944128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7e3cd-97b1-4a3b-a248-7dc1e72c6d88 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:28.949880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:28.950824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:28.951165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:28.951506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] PATH_INFO: `/v3/users/1869308fc60842eeadf47f67493a6660` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:28.954083 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1869308fc60842eeadf47f67493a6660)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:28.954825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:29.179023 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1869308fc60842eeadf47f67493a6660'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:29.179670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1869308fc60842eeadf47f67493a6660'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:29.186445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1869308fc60842eeadf47f67493a6660'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:29.187366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1869308fc60842eeadf47f67493a6660'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:29.330625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1869308fc60842eeadf47f67493a6660'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:29.350171 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1282/2576] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:28 2022] DELETE /identity/v3/users/1869308fc60842eeadf47f67493a6660 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:29.354735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bdc7d-7ef0-45fb-a5ec-179fd9473325 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:29.355055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bdc7d-7ef0-45fb-a5ec-179fd9473325 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:29.365174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bdc7d-7ef0-45fb-a5ec-179fd9473325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:29.372637 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-124bdc7d-7ef0-45fb-a5ec-179fd9473325 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:29.374182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-124bdc7d-7ef0-45fb-a5ec-179fd9473325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:29.435539 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1295/2577] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:29.445203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:29.446824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:29.511537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c63e14-d859-4753-9955-4965cf3dd725 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:29.516027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfad0f-a1b2-4e0a-8909-a17df1bed195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:29.516674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfad0f-a1b2-4e0a-8909-a17df1bed195 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:29.516957 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfad0f-a1b2-4e0a-8909-a17df1bed195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:29.517232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfad0f-a1b2-4e0a-8909-a17df1bed195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:29.529214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfad0f-a1b2-4e0a-8909-a17df1bed195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:29.531508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfad0f-a1b2-4e0a-8909-a17df1bed195 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:29.541292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1283/2578] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:29.966222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bdc7d-7ef0-45fb-a5ec-179fd9473325 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:29.967810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-124bdc7d-7ef0-45fb-a5ec-179fd9473325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:29.981394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bdc7d-7ef0-45fb-a5ec-179fd9473325 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.000200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e689e-b46d-4526-a973-14c5e5dcd6d7 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.000638 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e689e-b46d-4526-a973-14c5e5dcd6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.001043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e689e-b46d-4526-a973-14c5e5dcd6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.007107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.017230 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.017621 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.017862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] PATH_INFO: `/v3/projects/1fdc3eb31c304e1aac6eba64b2b649a8` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.021582 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdc3eb31c304e1aac6eba64b2b649a8)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.023780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.037761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f58e689e-b46d-4526-a973-14c5e5dcd6d7 None None] MFA Rules not processed for user `663a6375cf9f47d0b7b0c5a12e3c7195`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:30.039320 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f58e689e-b46d-4526-a973-14c5e5dcd6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:30.111869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1284/2579] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:30.116185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e689e-b46d-4526-a973-14c5e5dcd6d7 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.117552 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f58e689e-b46d-4526-a973-14c5e5dcd6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:30.131127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e689e-b46d-4526-a973-14c5e5dcd6d7 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.135774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e782-c276-40b9-a242-97a52f9f0f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.136435 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e782-c276-40b9-a242-97a52f9f0f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.136707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e782-c276-40b9-a242-97a52f9f0f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.136986 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30e782-c276-40b9-a242-97a52f9f0f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.137670 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30e782-c276-40b9-a242-97a52f9f0f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.139642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30e782-c276-40b9-a242-97a52f9f0f7d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.187700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdc3eb31c304e1aac6eba64b2b649a8', 'request_id': 'req-69cc4670-c930-4f1b-b3a6-61863cb2520b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:30.260701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdc3eb31c304e1aac6eba64b2b649a8', 'request_id': 'req-69cc4670-c930-4f1b-b3a6-61863cb2520b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:30.274329 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdc3eb31c304e1aac6eba64b2b649a8', 'request_id': 'req-69cc4670-c930-4f1b-b3a6-61863cb2520b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:30.274678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1285/2580] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:30 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:30.276419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e782-c276-40b9-a242-97a52f9f0f7d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.282220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] The token cache is being invalidate because project 1fdc3eb31c304e1aac6eba64b2b649a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:30.283073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:30.283821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-69cc4670-c930-4f1b-b3a6-61863cb2520b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:30.285744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1296/2581] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:29 2022] DELETE /identity/v3/projects/1fdc3eb31c304e1aac6eba64b2b649a8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:30.297475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a9a53-ff0f-4227-9ba8-8a2313c84061 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.297475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a9a53-ff0f-4227-9ba8-8a2313c84061 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.297475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a9a53-ff0f-4227-9ba8-8a2313c84061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.315300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c60a9a53-ff0f-4227-9ba8-8a2313c84061 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:30.316571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c60a9a53-ff0f-4227-9ba8-8a2313c84061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:30.345621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30e782-c276-40b9-a242-97a52f9f0f7d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.350315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d0ae-75f3-4ce2-a4eb-c27a7cb2be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.351022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d0ae-75f3-4ce2-a4eb-c27a7cb2be1f admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.351315 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d0ae-75f3-4ce2-a4eb-c27a7cb2be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.351591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d0ae-75f3-4ce2-a4eb-c27a7cb2be1f admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.352285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216d0ae-75f3-4ce2-a4eb-c27a7cb2be1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.354222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216d0ae-75f3-4ce2-a4eb-c27a7cb2be1f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.375834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1297/2582] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:30.383726 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5062-d961-40e9-96d0-f45b2c0ab922 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.384021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5062-d961-40e9-96d0-f45b2c0ab922 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.384306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba5062-d961-40e9-96d0-f45b2c0ab922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.402897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-ecba5062-d961-40e9-96d0-f45b2c0ab922 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:30.404141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ecba5062-d961-40e9-96d0-f45b2c0ab922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:30.412873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1298/2583] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:30.415294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1286/2584] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:30 2022] POST /identity/v3/users => generated 309 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:30.419290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba5062-d961-40e9-96d0-f45b2c0ab922 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.419449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d0ae-75f3-4ce2-a4eb-c27a7cb2be1f admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.420852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ecba5062-d961-40e9-96d0-f45b2c0ab922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:30.429651 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d0ae-75f3-4ce2-a4eb-c27a7cb2be1f admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.433421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba5062-d961-40e9-96d0-f45b2c0ab922 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.434893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.435540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.435828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.436278 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.437042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:30.437883 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.439054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ac8ea-b4f2-46b6-b8bb-a36010c7421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.439506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.439715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ac8ea-b4f2-46b6-b8bb-a36010c7421d admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.440011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ac8ea-b4f2-46b6-b8bb-a36010c7421d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.440294 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ac8ea-b4f2-46b6-b8bb-a36010c7421d admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.441031 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ac8ea-b4f2-46b6-b8bb-a36010c7421d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.442649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ac8ea-b4f2-46b6-b8bb-a36010c7421d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.451557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1287/2585] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:46:30.452801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1299/2586] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:30.455901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.456951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ac8ea-b4f2-46b6-b8bb-a36010c7421d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.465557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73bef7-0568-46f6-b4f8-5e7e2e90e7ec admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.466735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ac8ea-b4f2-46b6-b8bb-a36010c7421d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.470832 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886215a-3755-4b49-8167-ededbefd30a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.471472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886215a-3755-4b49-8167-ededbefd30a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.471761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886215a-3755-4b49-8167-ededbefd30a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.471896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff4e1-27fd-4f38-a2c9-e4d40beb2c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.472037 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886215a-3755-4b49-8167-ededbefd30a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.472687 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff4e1-27fd-4f38-a2c9-e4d40beb2c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.472803 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886215a-3755-4b49-8167-ededbefd30a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.472974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff4e1-27fd-4f38-a2c9-e4d40beb2c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.473249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aff4e1-27fd-4f38-a2c9-e4d40beb2c91 admin admin] PATH_INFO: `/v3/projects/a760983bae5c48f791b9a523f7804d69/users/fa4af2ee6dca4eefbd1f47c0cf802950/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.474605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886215a-3755-4b49-8167-ededbefd30a0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.488741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aff4e1-27fd-4f38-a2c9-e4d40beb2c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a760983bae5c48f791b9a523f7804d69, user_id=fa4af2ee6dca4eefbd1f47c0cf802950, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.491485 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aff4e1-27fd-4f38-a2c9-e4d40beb2c91 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.548761 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1288/2587] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:30 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:30.552721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886215a-3755-4b49-8167-ededbefd30a0 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.570648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1300/2588] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:30 2022] PUT /identity/v3/projects/a760983bae5c48f791b9a523f7804d69/users/fa4af2ee6dca4eefbd1f47c0cf802950/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:30.574452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff4e1-27fd-4f38-a2c9-e4d40beb2c91 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.616462 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886215a-3755-4b49-8167-ededbefd30a0 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.640622 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aff4e1-27fd-4f38-a2c9-e4d40beb2c91 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.645369 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaafa0-6c89-4dc4-9483-a44318fc189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.646024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaafa0-6c89-4dc4-9483-a44318fc189c admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.646310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaafa0-6c89-4dc4-9483-a44318fc189c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.646615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eaafa0-6c89-4dc4-9483-a44318fc189c admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.647346 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaafa0-6c89-4dc4-9483-a44318fc189c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.648949 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eaafa0-6c89-4dc4-9483-a44318fc189c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.659820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1301/2589] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:30.663738 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaafa0-6c89-4dc4-9483-a44318fc189c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.674231 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eaafa0-6c89-4dc4-9483-a44318fc189c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.677833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c10a5-6c5c-47f0-a593-6f97f075a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.682741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c10a5-6c5c-47f0-a593-6f97f075a296 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.682741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c10a5-6c5c-47f0-a593-6f97f075a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.682741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c10a5-6c5c-47f0-a593-6f97f075a296 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.683049 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc1e6-634d-424a-850a-ee76ab3444ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.683172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c10a5-6c5c-47f0-a593-6f97f075a296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.683273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc1e6-634d-424a-850a-ee76ab3444ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.683273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc1e6-634d-424a-850a-ee76ab3444ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.683273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc1e6-634d-424a-850a-ee76ab3444ef admin admin] PATH_INFO: `/v3/projects/a760983bae5c48f791b9a523f7804d69/users/fa4af2ee6dca4eefbd1f47c0cf802950/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.683523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c10a5-6c5c-47f0-a593-6f97f075a296 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.683627 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fc1e6-634d-424a-850a-ee76ab3444ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a760983bae5c48f791b9a523f7804d69, user_id=fa4af2ee6dca4eefbd1f47c0cf802950, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.685200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fc1e6-634d-424a-850a-ee76ab3444ef admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.696152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1302/2590] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:30 2022] PUT /identity/v3/projects/a760983bae5c48f791b9a523f7804d69/users/fa4af2ee6dca4eefbd1f47c0cf802950/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:30.782296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1289/2591] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:30 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:30.786194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc1e6-634d-424a-850a-ee76ab3444ef admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.848807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc1e6-634d-424a-850a-ee76ab3444ef admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.853888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebda94-b357-40e3-8a76-aa46a0d8ba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.854921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebda94-b357-40e3-8a76-aa46a0d8ba63 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.854921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebda94-b357-40e3-8a76-aa46a0d8ba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.855158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebda94-b357-40e3-8a76-aa46a0d8ba63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.855892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebda94-b357-40e3-8a76-aa46a0d8ba63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.857502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebda94-b357-40e3-8a76-aa46a0d8ba63 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.867597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1303/2592] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:30.871645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c10a5-6c5c-47f0-a593-6f97f075a296 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.881545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c10a5-6c5c-47f0-a593-6f97f075a296 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.886113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efc54e-aee2-49e6-b7e4-600f6ae03992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.888537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc54e-aee2-49e6-b7e4-600f6ae03992 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.888537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc54e-aee2-49e6-b7e4-600f6ae03992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.888537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efc54e-aee2-49e6-b7e4-600f6ae03992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.888537 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efc54e-aee2-49e6-b7e4-600f6ae03992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.889666 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efc54e-aee2-49e6-b7e4-600f6ae03992 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.899856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1290/2593] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:30.904395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebda94-b357-40e3-8a76-aa46a0d8ba63 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:30.915262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebda94-b357-40e3-8a76-aa46a0d8ba63 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:30.919913 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:30.920817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:30.921104 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:30.921408 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] PATH_INFO: `/v3/projects/5c4273160bc44808b1b5ad8dd9fee828/users/e3cb95e59e354cf3b55407b8873fad0c/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:30.936184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4273160bc44808b1b5ad8dd9fee828, user_id=e3cb95e59e354cf3b55407b8873fad0c, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:30.938927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:30.998593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1304/2594] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:30 2022] PUT /identity/v3/projects/5c4273160bc44808b1b5ad8dd9fee828/users/e3cb95e59e354cf3b55407b8873fad0c/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:31.003560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfd294-8ba8-410c-9039-6d02195e73c8 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:31.003854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfd294-8ba8-410c-9039-6d02195e73c8 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:31.004170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfd294-8ba8-410c-9039-6d02195e73c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:31.022047 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-6abfd294-8ba8-410c-9039-6d02195e73c8 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:31.023342 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6abfd294-8ba8-410c-9039-6d02195e73c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:31.083858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1291/2595] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:31.093216 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:31.096023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:31.154681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbf4c-9d14-4f99-8917-95ff97256373 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:31.159255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfe1b9-47e7-4f0a-ba1b-36c10e88d0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:31.159928 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe1b9-47e7-4f0a-ba1b-36c10e88d0be service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:31.160217 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe1b9-47e7-4f0a-ba1b-36c10e88d0be service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:31.161553 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe1b9-47e7-4f0a-ba1b-36c10e88d0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:31.170682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfe1b9-47e7-4f0a-ba1b-36c10e88d0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:31.172229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfe1b9-47e7-4f0a-ba1b-36c10e88d0be service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:31.183394 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1305/2596] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:31.327455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfd294-8ba8-410c-9039-6d02195e73c8 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:31.329639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-6abfd294-8ba8-410c-9039-6d02195e73c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:31.345928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfd294-8ba8-410c-9039-6d02195e73c8 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:31.352578 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:31.353801 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:31.354305 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:31.354815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] PATH_INFO: `/v3/users/43a9ff63594f4effb78d50e2f7b5645b` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:31.356314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a9ff63594f4effb78d50e2f7b5645b)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:31.358494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:31.561848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a9ff63594f4effb78d50e2f7b5645b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:31.563390 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a9ff63594f4effb78d50e2f7b5645b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:31.573849 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a9ff63594f4effb78d50e2f7b5645b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:31.574682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a9ff63594f4effb78d50e2f7b5645b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:31.661202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a9ff63594f4effb78d50e2f7b5645b'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:31.679805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1292/2597] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:31 2022] DELETE /identity/v3/users/43a9ff63594f4effb78d50e2f7b5645b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:31.684469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5302e26-047c-49e9-b994-40b6e203e31f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:31.684811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5302e26-047c-49e9-b994-40b6e203e31f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:31.685336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5302e26-047c-49e9-b994-40b6e203e31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:31.704632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d5302e26-047c-49e9-b994-40b6e203e31f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:31.708170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d5302e26-047c-49e9-b994-40b6e203e31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:31.773240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1306/2598] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:31.784630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:31.786626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:31.852637 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0a02-369d-4667-aef2-b058a2c9bfbc admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:31.856757 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91f9ff-de0f-4d57-b996-6b5ea5d67a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:31.861528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f9ff-de0f-4d57-b996-6b5ea5d67a28 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:31.861528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f9ff-de0f-4d57-b996-6b5ea5d67a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:31.861528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f9ff-de0f-4d57-b996-6b5ea5d67a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:31.871169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91f9ff-de0f-4d57-b996-6b5ea5d67a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:31.872692 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91f9ff-de0f-4d57-b996-6b5ea5d67a28 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:31.889864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1293/2599] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:31.892457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e5a1-47f2-436b-8504-65200e70f745 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:31.892757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e5a1-47f2-436b-8504-65200e70f745 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:31.893040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787e5a1-47f2-436b-8504-65200e70f745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:31.926124 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-8787e5a1-47f2-436b-8504-65200e70f745 None None] MFA Rules not processed for user `fa4af2ee6dca4eefbd1f47c0cf802950`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:31.927411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8787e5a1-47f2-436b-8504-65200e70f745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:32.016330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1307/2600] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:32.525591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff10a-84ed-4025-ab1c-d551a80b81de None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:32.526142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff10a-84ed-4025-ab1c-d551a80b81de None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:32.526142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ff10a-84ed-4025-ab1c-d551a80b81de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:32.554317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-0d1ff10a-84ed-4025-ab1c-d551a80b81de None None] MFA Rules not processed for user `e3cb95e59e354cf3b55407b8873fad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:32.555589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0d1ff10a-84ed-4025-ab1c-d551a80b81de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:32.567333 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e5a1-47f2-436b-8504-65200e70f745 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:32.569094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8787e5a1-47f2-436b-8504-65200e70f745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:32.588395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787e5a1-47f2-436b-8504-65200e70f745 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:32.594986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:32.596039 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:32.596804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:32.597191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] PATH_INFO: `/v3/projects/5b57d30a3fb342e9b6b8b0bde1243152` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:32.598704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b57d30a3fb342e9b6b8b0bde1243152)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:32.601334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:32.633863 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1294/2601] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:32.649588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff10a-84ed-4025-ab1c-d551a80b81de None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:32.651932 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0d1ff10a-84ed-4025-ab1c-d551a80b81de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:32.723051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ff10a-84ed-4025-ab1c-d551a80b81de None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:32.729877 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b57d30a3fb342e9b6b8b0bde1243152', 'request_id': 'req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:32.774020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:32.774851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:32.775124 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:32.775403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:32.786473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b57d30a3fb342e9b6b8b0bde1243152', 'request_id': 'req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:32.793813 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b57d30a3fb342e9b6b8b0bde1243152', 'request_id': 'req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:32.811591 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] The token cache is being invalidate because project 5b57d30a3fb342e9b6b8b0bde1243152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:32.811967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:32.814276 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:32.816495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1308/2602] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:32 2022] DELETE /identity/v3/projects/5b57d30a3fb342e9b6b8b0bde1243152 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:32.850241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:32.851583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:32.864704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1295/2603] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:33.404712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:33.407114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:33.481811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e50c9-a8a1-4c88-8ef9-63826fe8d555 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:33.487024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:33.487927 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:33.488210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:33.488493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] PATH_INFO: `/v3/users/663a6375cf9f47d0b7b0c5a12e3c7195` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:33.489682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] RBAC: Authorizing `identity:delete_user(user_id=663a6375cf9f47d0b7b0c5a12e3c7195)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:33.491630 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:33.686051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663a6375cf9f47d0b7b0c5a12e3c7195'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:33.692663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663a6375cf9f47d0b7b0c5a12e3c7195'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:33.693324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663a6375cf9f47d0b7b0c5a12e3c7195'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:33.693931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663a6375cf9f47d0b7b0c5a12e3c7195'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:33.780572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663a6375cf9f47d0b7b0c5a12e3c7195'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:33.799258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1309/2604] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:33 2022] DELETE /identity/v3/users/663a6375cf9f47d0b7b0c5a12e3c7195 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:34.028054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:34.029492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:34.048295 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34915df-5103-4e36-b0e1-9a525fa9da2c service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:34.107025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:34.108007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:34.108288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:34.108563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] PATH_INFO: `/v3/projects/9ca50eeeee404600a8b5981bedbfa545` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:34.109765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca50eeeee404600a8b5981bedbfa545)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:34.111857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:34.204180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca50eeeee404600a8b5981bedbfa545', 'request_id': 'req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.283723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca50eeeee404600a8b5981bedbfa545', 'request_id': 'req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.289506 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca50eeeee404600a8b5981bedbfa545', 'request_id': 'req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.300230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] The token cache is being invalidate because project 9ca50eeeee404600a8b5981bedbfa545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:34.300518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.301144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b30ed58b-92a0-4471-bdbd-23b7d0f10c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.302715 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1296/2605] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:34 2022] DELETE /identity/v3/projects/9ca50eeeee404600a8b5981bedbfa545 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:34.306620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:34.308013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:34.321390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd4355-8ddd-446b-b379-fd06ea17138d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:34.375774 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:34.376632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:34.376915 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:34.377194 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] PATH_INFO: `/v3/users/fa4af2ee6dca4eefbd1f47c0cf802950` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:34.378368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4af2ee6dca4eefbd1f47c0cf802950)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:34.380304 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:34.528439 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4af2ee6dca4eefbd1f47c0cf802950'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.534818 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e85a6-1fbe-4903-b6ae-8b0ebf0dc931 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:34.535317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e85a6-1fbe-4903-b6ae-8b0ebf0dc931 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:34.535800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e85a6-1fbe-4903-b6ae-8b0ebf0dc931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:34.536061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4af2ee6dca4eefbd1f47c0cf802950'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.536789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4af2ee6dca4eefbd1f47c0cf802950'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.537404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4af2ee6dca4eefbd1f47c0cf802950'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.554453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-fb1e85a6-1fbe-4903-b6ae-8b0ebf0dc931 None None] MFA Rules not processed for user `e3cb95e59e354cf3b55407b8873fad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:34.555696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fb1e85a6-1fbe-4903-b6ae-8b0ebf0dc931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:34.613243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1297/2606] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:34.626807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-42b7878d-865f-4bf6-a1ef-09c86f415843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4af2ee6dca4eefbd1f47c0cf802950'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:34.647050 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1310/2607] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:34 2022] DELETE /identity/v3/users/fa4af2ee6dca4eefbd1f47c0cf802950 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:34.892705 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e85a6-1fbe-4903-b6ae-8b0ebf0dc931 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:34.894346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fb1e85a6-1fbe-4903-b6ae-8b0ebf0dc931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:34.911353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e85a6-1fbe-4903-b6ae-8b0ebf0dc931 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:34.968875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:34.969745 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:34.970031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:34.970311 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] PATH_INFO: `/v3/projects/a760983bae5c48f791b9a523f7804d69` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:34.971539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a760983bae5c48f791b9a523f7804d69)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:34.973445 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:35.077907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a760983bae5c48f791b9a523f7804d69', 'request_id': 'req-8fade6b7-8ccb-49db-b4a7-09959aad34ba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:35.151858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a760983bae5c48f791b9a523f7804d69', 'request_id': 'req-8fade6b7-8ccb-49db-b4a7-09959aad34ba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:35.157945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a760983bae5c48f791b9a523f7804d69', 'request_id': 'req-8fade6b7-8ccb-49db-b4a7-09959aad34ba'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:35.169146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] The token cache is being invalidate because project a760983bae5c48f791b9a523f7804d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:35.169431 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:35.170461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8fade6b7-8ccb-49db-b4a7-09959aad34ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:35.175894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1298/2608] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:34 2022] DELETE /identity/v3/projects/a760983bae5c48f791b9a523f7804d69 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:35.177551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a20db-1a34-4196-b6ce-5af2a2cf0a98 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.177951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a20db-1a34-4196-b6ce-5af2a2cf0a98 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.178338 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a20db-1a34-4196-b6ce-5af2a2cf0a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.205946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-209a20db-1a34-4196-b6ce-5af2a2cf0a98 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:35.207208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-209a20db-1a34-4196-b6ce-5af2a2cf0a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:35.272527 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1311/2609] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:35.282570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a927-23ba-44d1-92b8-26f3f8771668 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.282744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a927-23ba-44d1-92b8-26f3f8771668 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.283029 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a927-23ba-44d1-92b8-26f3f8771668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.301766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-d171a927-23ba-44d1-92b8-26f3f8771668 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:35.303179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d171a927-23ba-44d1-92b8-26f3f8771668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:35.311875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1299/2610] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:35.316306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a20db-1a34-4196-b6ce-5af2a2cf0a98 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:35.326528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a20db-1a34-4196-b6ce-5af2a2cf0a98 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:35.332008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:35.332668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.332955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.333263 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.334000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:35.334311 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:35.335951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:35.351629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1312/2611] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:46:35.352718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171a927-23ba-44d1-92b8-26f3f8771668 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:35.362330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171a927-23ba-44d1-92b8-26f3f8771668 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:35.367134 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4d8e7-de08-414a-a8c2-d3f124978060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:35.367784 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4d8e7-de08-414a-a8c2-d3f124978060 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.368071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4d8e7-de08-414a-a8c2-d3f124978060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.368353 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4d8e7-de08-414a-a8c2-d3f124978060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.369057 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4d8e7-de08-414a-a8c2-d3f124978060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:35.370988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4d8e7-de08-414a-a8c2-d3f124978060 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:35.444373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1300/2612] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:35 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:35.448899 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:35.459598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9870d9-87e6-4c43-aa85-bbc699ad8e61 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:35.516383 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e15e-204d-44a7-8506-83c675dec874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:35.517067 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e15e-204d-44a7-8506-83c675dec874 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.517349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e15e-204d-44a7-8506-83c675dec874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.517625 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e15e-204d-44a7-8506-83c675dec874 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.518326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e15e-204d-44a7-8506-83c675dec874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:35.520283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e15e-204d-44a7-8506-83c675dec874 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:35.592035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1313/2613] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:35 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:35.597211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4d8e7-de08-414a-a8c2-d3f124978060 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:35.607672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4d8e7-de08-414a-a8c2-d3f124978060 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:35.613141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405dd22-d3e9-4602-8deb-9fade6395c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:35.613815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405dd22-d3e9-4602-8deb-9fade6395c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.614103 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405dd22-d3e9-4602-8deb-9fade6395c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.614409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405dd22-d3e9-4602-8deb-9fade6395c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.615261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405dd22-d3e9-4602-8deb-9fade6395c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:35.616854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405dd22-d3e9-4602-8deb-9fade6395c8c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:35.628010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1301/2614] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:35.632118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e15e-204d-44a7-8506-83c675dec874 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:35.642287 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e15e-204d-44a7-8506-83c675dec874 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:35.647163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59ac54-c187-4333-bd73-5175987cd389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:35.647816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59ac54-c187-4333-bd73-5175987cd389 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.648357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59ac54-c187-4333-bd73-5175987cd389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.648357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59ac54-c187-4333-bd73-5175987cd389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.649091 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59ac54-c187-4333-bd73-5175987cd389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:35.650723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59ac54-c187-4333-bd73-5175987cd389 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:35.661149 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1314/2615] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:35.665480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405dd22-d3e9-4602-8deb-9fade6395c8c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:35.677412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405dd22-d3e9-4602-8deb-9fade6395c8c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:35.682528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cfad2-ad39-4d53-8877-af9a88872b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:35.683488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfad2-ad39-4d53-8877-af9a88872b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.683837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfad2-ad39-4d53-8877-af9a88872b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.684130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cfad2-ad39-4d53-8877-af9a88872b86 admin admin] PATH_INFO: `/v3/projects/207f700dc7044f649f569f07b7e70cfd/users/690ded0c44874f34a3ed01d9b969de13/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.700854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cfad2-ad39-4d53-8877-af9a88872b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207f700dc7044f649f569f07b7e70cfd, user_id=690ded0c44874f34a3ed01d9b969de13, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:35.704417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cfad2-ad39-4d53-8877-af9a88872b86 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:35.845234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1302/2616] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:35 2022] PUT /identity/v3/projects/207f700dc7044f649f569f07b7e70cfd/users/690ded0c44874f34a3ed01d9b969de13/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:35.855598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10928b55-e7cf-424d-a8ae-64e33afc9cdf None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:35.855902 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10928b55-e7cf-424d-a8ae-64e33afc9cdf None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:35.856184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10928b55-e7cf-424d-a8ae-64e33afc9cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:35.884990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-10928b55-e7cf-424d-a8ae-64e33afc9cdf None None] MFA Rules not processed for user `690ded0c44874f34a3ed01d9b969de13`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:35.886222 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-10928b55-e7cf-424d-a8ae-64e33afc9cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:35.951651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1315/2617] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:35.956270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cfad2-ad39-4d53-8877-af9a88872b86 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:36.018627 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cfad2-ad39-4d53-8877-af9a88872b86 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:36.023408 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c7acb-e142-446e-a9af-f49c0f363fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:36.024073 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c7acb-e142-446e-a9af-f49c0f363fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.024360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c7acb-e142-446e-a9af-f49c0f363fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.024641 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c7acb-e142-446e-a9af-f49c0f363fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:36.025343 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c7acb-e142-446e-a9af-f49c0f363fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:36.027535 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c7acb-e142-446e-a9af-f49c0f363fb2 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:36.120000 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1303/2618] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:35 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:36.124011 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10928b55-e7cf-424d-a8ae-64e33afc9cdf None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:36.134723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10928b55-e7cf-424d-a8ae-64e33afc9cdf None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:36.191519 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eaf25-0b44-4dc6-bee5-583436f0812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:36.192198 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaf25-0b44-4dc6-bee5-583436f0812b admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.192486 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaf25-0b44-4dc6-bee5-583436f0812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.192765 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eaf25-0b44-4dc6-bee5-583436f0812b admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:36.193466 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eaf25-0b44-4dc6-bee5-583436f0812b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:36.195427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eaf25-0b44-4dc6-bee5-583436f0812b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:36.308357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1316/2619] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:36 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:36.312518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c7acb-e142-446e-a9af-f49c0f363fb2 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:36.326113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c7acb-e142-446e-a9af-f49c0f363fb2 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:36.342117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a7d-8e5b-4ec6-9e53-a3cc82d56e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:36.342864 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a7d-8e5b-4ec6-9e53-a3cc82d56e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.343152 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a7d-8e5b-4ec6-9e53-a3cc82d56e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.343428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109a7d-8e5b-4ec6-9e53-a3cc82d56e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:36.344835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109a7d-8e5b-4ec6-9e53-a3cc82d56e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:36.346465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109a7d-8e5b-4ec6-9e53-a3cc82d56e1a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:36.358911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1304/2620] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:36.362804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eaf25-0b44-4dc6-bee5-583436f0812b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:36.373280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eaf25-0b44-4dc6-bee5-583436f0812b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:36.377929 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef9fb-5a75-4177-95c9-0c89e3dd2cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:36.378860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef9fb-5a75-4177-95c9-0c89e3dd2cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.379329 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef9fb-5a75-4177-95c9-0c89e3dd2cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.379610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ef9fb-5a75-4177-95c9-0c89e3dd2cc9 admin admin] PATH_INFO: `/v3/projects/798e0ba2fb144864b66a8b8e324032b1/users/771e570524e0440cb11ecdc1a6c5e435/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:36.395343 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ef9fb-5a75-4177-95c9-0c89e3dd2cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798e0ba2fb144864b66a8b8e324032b1, user_id=771e570524e0440cb11ecdc1a6c5e435, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:36.398032 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ef9fb-5a75-4177-95c9-0c89e3dd2cc9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:36.461595 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1317/2621] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:36 2022] PUT /identity/v3/projects/798e0ba2fb144864b66a8b8e324032b1/users/771e570524e0440cb11ecdc1a6c5e435/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:36.465805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a7d-8e5b-4ec6-9e53-a3cc82d56e1a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:36.476186 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109a7d-8e5b-4ec6-9e53-a3cc82d56e1a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:36.536215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70759b2a-b50e-42b4-9900-bcf59935a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:36.536898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759b2a-b50e-42b4-9900-bcf59935a1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.537184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759b2a-b50e-42b4-9900-bcf59935a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.537481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759b2a-b50e-42b4-9900-bcf59935a1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:36.538268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70759b2a-b50e-42b4-9900-bcf59935a1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:36.539989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70759b2a-b50e-42b4-9900-bcf59935a1ca admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:36.550354 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1305/2622] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:36.554564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef9fb-5a75-4177-95c9-0c89e3dd2cc9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:36.565895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ef9fb-5a75-4177-95c9-0c89e3dd2cc9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:36.570793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:36.571685 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.571972 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.572250 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] PATH_INFO: `/v3/projects/798e0ba2fb144864b66a8b8e324032b1/users/771e570524e0440cb11ecdc1a6c5e435/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:36.574369 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798e0ba2fb144864b66a8b8e324032b1, user_id=771e570524e0440cb11ecdc1a6c5e435, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:36.577122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:36.588828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1318/2623] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:36 2022] PUT /identity/v3/projects/798e0ba2fb144864b66a8b8e324032b1/users/771e570524e0440cb11ecdc1a6c5e435/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:36.598975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7e63-6fd6-45bd-b526-38643dd87d27 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.599282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7e63-6fd6-45bd-b526-38643dd87d27 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.599570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7e63-6fd6-45bd-b526-38643dd87d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:36.626448 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-f6db7e63-6fd6-45bd-b526-38643dd87d27 None None] MFA Rules not processed for user `771e570524e0440cb11ecdc1a6c5e435`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:36.627615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f6db7e63-6fd6-45bd-b526-38643dd87d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:36.695877 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1306/2624] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:36.707584 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:36.709270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:36.767563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08be13-e2be-417f-9024-ad6a8161b2f8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:36.771329 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:36.771974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.772264 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.772541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:36.781824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:36.783293 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:36.792739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1319/2625] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:36.941600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db7e63-6fd6-45bd-b526-38643dd87d27 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:36.943122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f6db7e63-6fd6-45bd-b526-38643dd87d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:36.955619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db7e63-6fd6-45bd-b526-38643dd87d27 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:36.959403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345c30d-fce8-4c0a-b018-83d8326e0bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:36.960051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c30d-fce8-4c0a-b018-83d8326e0bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:36.960338 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c30d-fce8-4c0a-b018-83d8326e0bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:36.960619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c30d-fce8-4c0a-b018-83d8326e0bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:37.024155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345c30d-fce8-4c0a-b018-83d8326e0bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:37.025602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345c30d-fce8-4c0a-b018-83d8326e0bc4 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:37.036294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1307/2626] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:45.229888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:45.232526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:45.303872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a17a8-cbd7-4ddd-ba34-bf3c41f1d53d service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:45.308880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8f84-f038-4464-9702-645bdaa61fe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded012db549b45669a4ffcdd988b55ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:45.311084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8f84-f038-4464-9702-645bdaa61fe2 service placement] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:45.311084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8f84-f038-4464-9702-645bdaa61fe2 service placement] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:45.311084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8f84-f038-4464-9702-645bdaa61fe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:45.312303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-de9a8f84-f038-4464-9702-645bdaa61fe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:45.324204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a8f84-f038-4464-9702-645bdaa61fe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:45.325771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a8f84-f038-4464-9702-645bdaa61fe2 service placement] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:45.336321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1320/2627] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:47.944077 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345c30d-fce8-4c0a-b018-83d8326e0bc4 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:48.014711 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345c30d-fce8-4c0a-b018-83d8326e0bc4 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:48.020002 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:48.020878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:48.021162 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:48.027461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] PATH_INFO: `/v3/users/690ded0c44874f34a3ed01d9b969de13` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:48.027461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690ded0c44874f34a3ed01d9b969de13)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:48.027461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:48.217540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690ded0c44874f34a3ed01d9b969de13'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:48.218214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690ded0c44874f34a3ed01d9b969de13'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:48.225712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690ded0c44874f34a3ed01d9b969de13'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:48.226439 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690ded0c44874f34a3ed01d9b969de13'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:48.271955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690ded0c44874f34a3ed01d9b969de13'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:48.290785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1308/2628] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:47 2022] DELETE /identity/v3/users/690ded0c44874f34a3ed01d9b969de13 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:48.295347 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1a1c-6cc0-481e-a5e8-6fed5799cdb9 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:48.295853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1a1c-6cc0-481e-a5e8-6fed5799cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:48.295969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1a1c-6cc0-481e-a5e8-6fed5799cdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:48.313832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-33ee1a1c-6cc0-481e-a5e8-6fed5799cdb9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:48.315087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-33ee1a1c-6cc0-481e-a5e8-6fed5799cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:48.373432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1321/2629] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:48.384167 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:48.385583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:48.443642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ad27b-3298-40d7-8352-e5e80dab9405 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:48.447499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c0da-a332-43c3-9062-2770ba83748a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:48.448158 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c0da-a332-43c3-9062-2770ba83748a service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:48.448449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c0da-a332-43c3-9062-2770ba83748a service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:48.448731 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c0da-a332-43c3-9062-2770ba83748a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:48.458256 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c0da-a332-43c3-9062-2770ba83748a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:48.459802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c0da-a332-43c3-9062-2770ba83748a service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:48.469523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1309/2630] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:48.833328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee1a1c-6cc0-481e-a5e8-6fed5799cdb9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:48.840790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-33ee1a1c-6cc0-481e-a5e8-6fed5799cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:48.848672 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee1a1c-6cc0-481e-a5e8-6fed5799cdb9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:48.853523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:48.854388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:48.854719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:48.855052 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] PATH_INFO: `/v3/projects/207f700dc7044f649f569f07b7e70cfd` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:48.856184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207f700dc7044f649f569f07b7e70cfd)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:48.858324 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:48.966978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207f700dc7044f649f569f07b7e70cfd', 'request_id': 'req-e095715c-cb28-49d6-be16-b29feee57829'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.031879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207f700dc7044f649f569f07b7e70cfd', 'request_id': 'req-e095715c-cb28-49d6-be16-b29feee57829'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.038065 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207f700dc7044f649f569f07b7e70cfd', 'request_id': 'req-e095715c-cb28-49d6-be16-b29feee57829'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.049890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] The token cache is being invalidate because project 207f700dc7044f649f569f07b7e70cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:49.049890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.050273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.052339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1322/2631] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:48 2022] DELETE /identity/v3/projects/207f700dc7044f649f569f07b7e70cfd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:49.056577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c0da-a332-43c3-9062-2770ba83748a service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:49.066931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c0da-a332-43c3-9062-2770ba83748a service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:49.122872 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:49.123766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:49.124031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:49.124312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] PATH_INFO: `/v3/users/771e570524e0440cb11ecdc1a6c5e435` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:49.125499 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771e570524e0440cb11ecdc1a6c5e435)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:49.127434 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:49.288605 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771e570524e0440cb11ecdc1a6c5e435'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.289539 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771e570524e0440cb11ecdc1a6c5e435'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.299792 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771e570524e0440cb11ecdc1a6c5e435'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.301657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771e570524e0440cb11ecdc1a6c5e435'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.351993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-938f1fa3-1d3f-4705-890f-e00cae8334c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771e570524e0440cb11ecdc1a6c5e435'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:49.369789 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1310/2632] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:49 2022] DELETE /identity/v3/users/771e570524e0440cb11ecdc1a6c5e435 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:49.764958 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:49.766425 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:49.781035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095715c-cb28-49d6-be16-b29feee57829 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:49.838741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:49.839604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:49.839888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:49.840166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] PATH_INFO: `/v3/projects/798e0ba2fb144864b66a8b8e324032b1` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:49.841336 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798e0ba2fb144864b66a8b8e324032b1)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:49.843313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:49.929157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798e0ba2fb144864b66a8b8e324032b1', 'request_id': 'req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:50.026450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798e0ba2fb144864b66a8b8e324032b1', 'request_id': 'req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:50.033327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798e0ba2fb144864b66a8b8e324032b1', 'request_id': 'req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:50.050060 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] The token cache is being invalidate because project 798e0ba2fb144864b66a8b8e324032b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:50.050440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:50.052280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f6ef76d1-105d-4c92-a0c5-ed8ff017d2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:50.053400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1323/2633] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:49 2022] DELETE /identity/v3/projects/798e0ba2fb144864b66a8b8e324032b1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:50.058342 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cbe38-a494-48f0-97e9-867f98ec7483 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.065204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cbe38-a494-48f0-97e9-867f98ec7483 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.065204 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cbe38-a494-48f0-97e9-867f98ec7483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.076800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-3e5cbe38-a494-48f0-97e9-867f98ec7483 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:50.078009 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3e5cbe38-a494-48f0-97e9-867f98ec7483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:50.136594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1311/2634] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:50.145568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923fa2-52c1-4cea-8072-07b6ab7996fa None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.145860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923fa2-52c1-4cea-8072-07b6ab7996fa None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.146137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923fa2-52c1-4cea-8072-07b6ab7996fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.165035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-12923fa2-52c1-4cea-8072-07b6ab7996fa None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:50.166240 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-12923fa2-52c1-4cea-8072-07b6ab7996fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:50.174165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1324/2635] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:50.178895 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cbe38-a494-48f0-97e9-867f98ec7483 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.188722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cbe38-a494-48f0-97e9-867f98ec7483 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.193293 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.193937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.194220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.194497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.195254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:50.195561 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.197142 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:50.208648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1312/2636] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:46:50.212814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12923fa2-52c1-4cea-8072-07b6ab7996fa None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.221978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12923fa2-52c1-4cea-8072-07b6ab7996fa None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.226707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7afcb-68eb-4628-892e-80a77a5a0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.227352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7afcb-68eb-4628-892e-80a77a5a0008 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.227663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7afcb-68eb-4628-892e-80a77a5a0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.227914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7afcb-68eb-4628-892e-80a77a5a0008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.228605 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7afcb-68eb-4628-892e-80a77a5a0008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.230549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7afcb-68eb-4628-892e-80a77a5a0008 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:50.308524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1325/2637] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:50 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:50.312540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.323755 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77f19-d1da-49fe-a6af-54e94d9dc5e0 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.386153 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ef34a-49df-47ef-9678-fa8074e3bffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.386867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ef34a-49df-47ef-9678-fa8074e3bffc admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.387157 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ef34a-49df-47ef-9678-fa8074e3bffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.387464 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ef34a-49df-47ef-9678-fa8074e3bffc admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.388158 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ef34a-49df-47ef-9678-fa8074e3bffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.390103 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ef34a-49df-47ef-9678-fa8074e3bffc admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:50.444386 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1313/2638] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:50 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:50.448424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7afcb-68eb-4628-892e-80a77a5a0008 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.459087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7afcb-68eb-4628-892e-80a77a5a0008 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.464107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6192b76-4842-4d18-901b-38cfdbdbb49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.464848 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192b76-4842-4d18-901b-38cfdbdbb49c admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.465136 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192b76-4842-4d18-901b-38cfdbdbb49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.465415 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192b76-4842-4d18-901b-38cfdbdbb49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.466139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6192b76-4842-4d18-901b-38cfdbdbb49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.467761 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6192b76-4842-4d18-901b-38cfdbdbb49c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:50.478334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1326/2639] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:50.482215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ef34a-49df-47ef-9678-fa8074e3bffc admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.492923 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ef34a-49df-47ef-9678-fa8074e3bffc admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.497894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22224313-9d3e-48b1-95d6-32e2e000a4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.498609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224313-9d3e-48b1-95d6-32e2e000a4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.498897 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224313-9d3e-48b1-95d6-32e2e000a4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.499186 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224313-9d3e-48b1-95d6-32e2e000a4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.499943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22224313-9d3e-48b1-95d6-32e2e000a4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.501527 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22224313-9d3e-48b1-95d6-32e2e000a4f9 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:50.517007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1314/2640] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:50.518158 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6192b76-4842-4d18-901b-38cfdbdbb49c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.528677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6192b76-4842-4d18-901b-38cfdbdbb49c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.533757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.534662 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.534953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.535232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] PATH_INFO: `/v3/projects/5057774d2dfd4705a2710d63f94a8068/users/6f7fe8e3b1f540468ab2dfebd7af9253/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.549724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5057774d2dfd4705a2710d63f94a8068, user_id=6f7fe8e3b1f540468ab2dfebd7af9253, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.552905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:50.605701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1327/2641] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:50 2022] PUT /identity/v3/projects/5057774d2dfd4705a2710d63f94a8068/users/6f7fe8e3b1f540468ab2dfebd7af9253/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:50.621086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012d79-8d07-4f44-86c9-ebbd9ad9d0c4 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.621377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012d79-8d07-4f44-86c9-ebbd9ad9d0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.621652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012d79-8d07-4f44-86c9-ebbd9ad9d0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.653209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-54012d79-8d07-4f44-86c9-ebbd9ad9d0c4 None None] MFA Rules not processed for user `6f7fe8e3b1f540468ab2dfebd7af9253`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:50.654662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-54012d79-8d07-4f44-86c9-ebbd9ad9d0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:50.681121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.682975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:50.726626 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1315/2642] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:50.729150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54012d79-8d07-4f44-86c9-ebbd9ad9d0c4 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.743974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e232964-3199-4618-b2e0-c4418d443b3b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.747715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.748362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.748648 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.748925 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.750785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:50.791452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54012d79-8d07-4f44-86c9-ebbd9ad9d0c4 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.796225 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaeffe-124f-4d53-beaa-1bce6e83b101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.796949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaeffe-124f-4d53-beaa-1bce6e83b101 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.797230 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaeffe-124f-4d53-beaa-1bce6e83b101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.797505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaeffe-124f-4d53-beaa-1bce6e83b101 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.798193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaeffe-124f-4d53-beaa-1bce6e83b101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.800101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaeffe-124f-4d53-beaa-1bce6e83b101 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:50.814688 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.816246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:50.826089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1328/2643] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:46:50.922939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1316/2644] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:50 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:50.924248 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:50.934946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6565e-a074-4f45-b7dc-ae5b4e11b3e4 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:50.993763 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f2e6-6469-4991-950e-1333156eae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:50.994494 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f2e6-6469-4991-950e-1333156eae99 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:50.994818 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f2e6-6469-4991-950e-1333156eae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:50.995103 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f2e6-6469-4991-950e-1333156eae99 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:50.995804 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f2e6-6469-4991-950e-1333156eae99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:50.997737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f2e6-6469-4991-950e-1333156eae99 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:51.080102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1329/2645] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:50 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:51.083642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaeffe-124f-4d53-beaa-1bce6e83b101 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:51.094748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaeffe-124f-4d53-beaa-1bce6e83b101 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:51.099769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bd201-d0f4-40ab-906a-4a719d76cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:51.100441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd201-d0f4-40ab-906a-4a719d76cef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:51.101348 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd201-d0f4-40ab-906a-4a719d76cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:51.101664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bd201-d0f4-40ab-906a-4a719d76cef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:51.102419 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bd201-d0f4-40ab-906a-4a719d76cef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:51.104083 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bd201-d0f4-40ab-906a-4a719d76cef7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:51.115657 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1317/2646] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:51.119904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f2e6-6469-4991-950e-1333156eae99 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:51.132207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f2e6-6469-4991-950e-1333156eae99 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:51.139681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066822f-357a-492e-9b12-eb5b4b7010a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:51.140626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066822f-357a-492e-9b12-eb5b4b7010a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:51.141014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066822f-357a-492e-9b12-eb5b4b7010a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:51.141300 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066822f-357a-492e-9b12-eb5b4b7010a5 admin admin] PATH_INFO: `/v3/projects/52c642efef2245f8a1630dc4978e800b/users/39813e235a6b4068979fa2e1dc8ed655/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:51.159732 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066822f-357a-492e-9b12-eb5b4b7010a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c642efef2245f8a1630dc4978e800b, user_id=39813e235a6b4068979fa2e1dc8ed655, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:51.163176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066822f-357a-492e-9b12-eb5b4b7010a5 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:51.278734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1330/2647] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:51 2022] PUT /identity/v3/projects/52c642efef2245f8a1630dc4978e800b/users/39813e235a6b4068979fa2e1dc8ed655/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:51.282699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bd201-d0f4-40ab-906a-4a719d76cef7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:51.303521 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bd201-d0f4-40ab-906a-4a719d76cef7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:51.368846 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35952b0-cd49-4f24-b90f-b45fa7c2625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:51.369488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35952b0-cd49-4f24-b90f-b45fa7c2625e admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:51.369777 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35952b0-cd49-4f24-b90f-b45fa7c2625e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:51.370083 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35952b0-cd49-4f24-b90f-b45fa7c2625e admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:51.370878 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35952b0-cd49-4f24-b90f-b45fa7c2625e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:51.372509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35952b0-cd49-4f24-b90f-b45fa7c2625e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:51.383969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1318/2648] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:51.388080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066822f-357a-492e-9b12-eb5b4b7010a5 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:51.398989 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066822f-357a-492e-9b12-eb5b4b7010a5 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:51.404634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:51.405649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:51.406133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:51.406290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] PATH_INFO: `/v3/projects/52c642efef2245f8a1630dc4978e800b/users/39813e235a6b4068979fa2e1dc8ed655/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:51.410495 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c642efef2245f8a1630dc4978e800b, user_id=39813e235a6b4068979fa2e1dc8ed655, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:51.413317 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:51.426411 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1331/2649] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:51 2022] PUT /identity/v3/projects/52c642efef2245f8a1630dc4978e800b/users/39813e235a6b4068979fa2e1dc8ed655/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:51.438007 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd0c7-a4cc-4160-951a-0d4288fb61e6 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:51.438307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd0c7-a4cc-4160-951a-0d4288fb61e6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:51.438682 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd0c7-a4cc-4160-951a-0d4288fb61e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:51.468243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-600bd0c7-a4cc-4160-951a-0d4288fb61e6 None None] MFA Rules not processed for user `39813e235a6b4068979fa2e1dc8ed655`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:51.469640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-600bd0c7-a4cc-4160-951a-0d4288fb61e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:51.543065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1319/2650] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:51 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:51.555616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:51.558404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:51.624642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6d1ad-cbff-4312-ba36-e1efdb0b30e3 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:51.629588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:51.630395 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:51.630879 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:51.631175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:51.642523 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:51.644235 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:51.654501 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1332/2651] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:51.873793 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd0c7-a4cc-4160-951a-0d4288fb61e6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:51.884549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd0c7-a4cc-4160-951a-0d4288fb61e6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:51.888403 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283713b8-6052-4351-a56e-64d7e49d3808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:51.889121 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283713b8-6052-4351-a56e-64d7e49d3808 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:51.889437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283713b8-6052-4351-a56e-64d7e49d3808 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:51.889713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283713b8-6052-4351-a56e-64d7e49d3808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:51.947933 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283713b8-6052-4351-a56e-64d7e49d3808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:51.949399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283713b8-6052-4351-a56e-64d7e49d3808 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:51.964453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1320/2652] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:46:54.662694 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:54.662694 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:54.739424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0f64f-42aa-45b0-b317-df8a9866a9a0 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:54.744403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:54.745340 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:54.745620 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:54.760100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] PATH_INFO: `/v3/users/50998395da9a417eaa555e714c998496` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:54.760100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50998395da9a417eaa555e714c998496)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:54.760100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:55.045192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50998395da9a417eaa555e714c998496'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.052445 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50998395da9a417eaa555e714c998496'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.053134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50998395da9a417eaa555e714c998496'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.053792 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50998395da9a417eaa555e714c998496'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.271616 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50998395da9a417eaa555e714c998496'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.292432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1333/2653] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:54 2022] DELETE /identity/v3/users/50998395da9a417eaa555e714c998496 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:55.482184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283713b8-6052-4351-a56e-64d7e49d3808 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:55.493097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283713b8-6052-4351-a56e-64d7e49d3808 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:55.530592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:55.532055 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:55.557764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:55.558688 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:55.559036 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:55.559239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] PATH_INFO: `/v3/users/6f7fe8e3b1f540468ab2dfebd7af9253` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:55.560485 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7fe8e3b1f540468ab2dfebd7af9253)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:55.562710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:55.611036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dfaa7-bc35-46e6-af83-b59df3c7dd52 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:55.615800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:55.616651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:55.616940 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:55.617218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] PATH_INFO: `/v3/projects/78547cd37d15479397107643e766fcb4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:55.618424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78547cd37d15479397107643e766fcb4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:55.620379 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:55.765770 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7fe8e3b1f540468ab2dfebd7af9253'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.766036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78547cd37d15479397107643e766fcb4', 'request_id': 'req-8beaa1e7-f0f2-4019-a005-7db6903ade0a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.766749 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7fe8e3b1f540468ab2dfebd7af9253'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.774102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7fe8e3b1f540468ab2dfebd7af9253'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.774842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7fe8e3b1f540468ab2dfebd7af9253'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.820799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78547cd37d15479397107643e766fcb4', 'request_id': 'req-8beaa1e7-f0f2-4019-a005-7db6903ade0a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.827681 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78547cd37d15479397107643e766fcb4', 'request_id': 'req-8beaa1e7-f0f2-4019-a005-7db6903ade0a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.838802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] The token cache is being invalidate because project 78547cd37d15479397107643e766fcb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:55.839100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.839757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8beaa1e7-f0f2-4019-a005-7db6903ade0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.841315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1334/2654] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:55 2022] DELETE /identity/v3/projects/78547cd37d15479397107643e766fcb4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:55.846014 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118f65-9c9a-4540-9626-766042b50311 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:55.846301 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118f65-9c9a-4540-9626-766042b50311 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:55.846608 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7118f65-9c9a-4540-9626-766042b50311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:55.866204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b7118f65-9c9a-4540-9626-766042b50311 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:55.867474 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b7118f65-9c9a-4540-9626-766042b50311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:55.906046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-6d5bf49d-c888-4119-9a08-5c0bbe4cb6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7fe8e3b1f540468ab2dfebd7af9253'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:55.925020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1321/2655] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:55 2022] DELETE /identity/v3/users/6f7fe8e3b1f540468ab2dfebd7af9253 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:55.928005 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1335/2656] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:55.929941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bec12-0bcc-43b7-9510-e1502d3eeac1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:55.930232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bec12-0bcc-43b7-9510-e1502d3eeac1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:55.930512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bec12-0bcc-43b7-9510-e1502d3eeac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:55.936157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0777-ee2a-4044-9c5e-49604d5462da None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:55.936455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0777-ee2a-4044-9c5e-49604d5462da None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:55.936740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0777-ee2a-4044-9c5e-49604d5462da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:55.949154 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-ee2bec12-0bcc-43b7-9510-e1502d3eeac1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:55.950937 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ee2bec12-0bcc-43b7-9510-e1502d3eeac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:55.955561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a4ef0777-ee2a-4044-9c5e-49604d5462da None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:55.956836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a4ef0777-ee2a-4044-9c5e-49604d5462da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:56.010375 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1322/2657] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:56.018211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1336/2658] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:56.021497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bec12-0bcc-43b7-9510-e1502d3eeac1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.022234 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0777-ee2a-4044-9c5e-49604d5462da None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.026625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ee2bec12-0bcc-43b7-9510-e1502d3eeac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:56.032589 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0777-ee2a-4044-9c5e-49604d5462da None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.038455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.039164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.039456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.039737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.040628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:56.040953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.042610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.055272 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1337/2659] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:46:56.059784 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.076598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bc860-7afa-413b-8ee0-4c1c587aee73 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.076598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fdddd-551c-407a-9f52-410010da84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.076934 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fdddd-551c-407a-9f52-410010da84e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.077037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fdddd-551c-407a-9f52-410010da84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.077278 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fdddd-551c-407a-9f52-410010da84e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.077974 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fdddd-551c-407a-9f52-410010da84e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.079931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fdddd-551c-407a-9f52-410010da84e8 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.087089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bec12-0bcc-43b7-9510-e1502d3eeac1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.090997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62456a5-aa66-44b2-8645-355beba9325e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.091664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62456a5-aa66-44b2-8645-355beba9325e service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.091953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62456a5-aa66-44b2-8645-355beba9325e service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.092239 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62456a5-aa66-44b2-8645-355beba9325e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.103716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62456a5-aa66-44b2-8645-355beba9325e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.105650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62456a5-aa66-44b2-8645-355beba9325e service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.116716 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1323/2660] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:46:56.152547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1338/2661] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:56 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:56.153734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62456a5-aa66-44b2-8645-355beba9325e service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.164283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62456a5-aa66-44b2-8645-355beba9325e service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.230683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fa51b-e3dd-4245-b34d-a79543227498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.231366 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fa51b-e3dd-4245-b34d-a79543227498 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.231655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fa51b-e3dd-4245-b34d-a79543227498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.231936 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fa51b-e3dd-4245-b34d-a79543227498 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.232672 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fa51b-e3dd-4245-b34d-a79543227498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.234636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fa51b-e3dd-4245-b34d-a79543227498 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.351440 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1324/2662] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:56 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:56.353102 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fdddd-551c-407a-9f52-410010da84e8 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.366388 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fdddd-551c-407a-9f52-410010da84e8 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.384296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ad559-ff5e-4854-b94a-3b54e00c523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.384296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ad559-ff5e-4854-b94a-3b54e00c523b admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.384296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ad559-ff5e-4854-b94a-3b54e00c523b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.384296 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ad559-ff5e-4854-b94a-3b54e00c523b admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.384871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ad559-ff5e-4854-b94a-3b54e00c523b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.384871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ad559-ff5e-4854-b94a-3b54e00c523b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.391078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1339/2663] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:56.395137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fa51b-e3dd-4245-b34d-a79543227498 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.405391 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fa51b-e3dd-4245-b34d-a79543227498 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.410421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.411456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.411708 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.412055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.412868 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.414896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.426075 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1325/2664] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:56.430249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ad559-ff5e-4854-b94a-3b54e00c523b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.440074 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ad559-ff5e-4854-b94a-3b54e00c523b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.445646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4288a-8634-4807-9862-6cbee0c579b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.450416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4288a-8634-4807-9862-6cbee0c579b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.450416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4288a-8634-4807-9862-6cbee0c579b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.450416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4288a-8634-4807-9862-6cbee0c579b1 admin admin] PATH_INFO: `/v3/projects/1b4c7d276bee4f1da0fb9dd0543665c8/users/949b2bfae88f4e5b90324cfd4f0e3095/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.467030 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4288a-8634-4807-9862-6cbee0c579b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4c7d276bee4f1da0fb9dd0543665c8, user_id=949b2bfae88f4e5b90324cfd4f0e3095, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.469724 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4288a-8634-4807-9862-6cbee0c579b1 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.525364 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.531169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:56.549055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd8c90-66b5-483a-a24b-04df819c71c3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.553979 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1340/2665] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:56 2022] PUT /identity/v3/projects/1b4c7d276bee4f1da0fb9dd0543665c8/users/949b2bfae88f4e5b90324cfd4f0e3095/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:56.565115 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6612688-dd08-41d6-906c-01842a60d5aa None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.568811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6612688-dd08-41d6-906c-01842a60d5aa None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.569113 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6612688-dd08-41d6-906c-01842a60d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.595122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f6612688-dd08-41d6-906c-01842a60d5aa None None] MFA Rules not processed for user `949b2bfae88f4e5b90324cfd4f0e3095`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:56.596477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f6612688-dd08-41d6-906c-01842a60d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:56.609676 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.613704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.613704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.613704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] PATH_INFO: `/v3/projects/5057774d2dfd4705a2710d63f94a8068` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.613704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5057774d2dfd4705a2710d63f94a8068)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.614889 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.667118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1341/2666] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:56.679140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6612688-dd08-41d6-906c-01842a60d5aa None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.680517 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f6612688-dd08-41d6-906c-01842a60d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:56.723425 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5057774d2dfd4705a2710d63f94a8068', 'request_id': 'req-1f2e915f-3073-4d1f-90c4-2e1cbe979800'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:56.757182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6612688-dd08-41d6-906c-01842a60d5aa None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.786703 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5057774d2dfd4705a2710d63f94a8068', 'request_id': 'req-1f2e915f-3073-4d1f-90c4-2e1cbe979800'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:56.793507 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5057774d2dfd4705a2710d63f94a8068', 'request_id': 'req-1f2e915f-3073-4d1f-90c4-2e1cbe979800'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:56.806585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] The token cache is being invalidate because project 5057774d2dfd4705a2710d63f94a8068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:56.806963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:56.807819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:56.809841 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1326/2667] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:56 2022] DELETE /identity/v3/projects/5057774d2dfd4705a2710d63f94a8068 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:56.813811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:56.816329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:56.824666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.825374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.825810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.826176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.828207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:56.884825 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e915f-3073-4d1f-90c4-2e1cbe979800 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:56.889650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:56.890244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.890563 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:56.890858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:56.891141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] PATH_INFO: `/v3/users/39813e235a6b4068979fa2e1dc8ed655` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:56.891896 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.892350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39813e235a6b4068979fa2e1dc8ed655)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:56.894441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:56.901413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1342/2668] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:46:57.058262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39813e235a6b4068979fa2e1dc8ed655'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.058962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39813e235a6b4068979fa2e1dc8ed655'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.065722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39813e235a6b4068979fa2e1dc8ed655'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.066655 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39813e235a6b4068979fa2e1dc8ed655'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.157616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-58c59da3-420e-46c4-bb6f-30ed7f38b171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39813e235a6b4068979fa2e1dc8ed655'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.176815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1327/2669] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:46:56 2022] DELETE /identity/v3/users/39813e235a6b4068979fa2e1dc8ed655 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:57.606025 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:57.618663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c65c4-44eb-41f6-bf6f-ff80ad4faeb4 service nova] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:57.687728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:57.688606 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:57.688888 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:57.689166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] PATH_INFO: `/v3/projects/52c642efef2245f8a1630dc4978e800b` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:57.690449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c642efef2245f8a1630dc4978e800b)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:57.692534 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:57.803872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c642efef2245f8a1630dc4978e800b', 'request_id': 'req-e13e8761-29be-4e51-90ac-e1fd88779c3b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.883185 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c642efef2245f8a1630dc4978e800b', 'request_id': 'req-e13e8761-29be-4e51-90ac-e1fd88779c3b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.889312 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c642efef2245f8a1630dc4978e800b', 'request_id': 'req-e13e8761-29be-4e51-90ac-e1fd88779c3b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.900670 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] The token cache is being invalidate because project 52c642efef2245f8a1630dc4978e800b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:46:57.900963 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.901598 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-e13e8761-29be-4e51-90ac-e1fd88779c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:46:57.903442 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1343/2670] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:46:57 2022] DELETE /identity/v3/projects/52c642efef2245f8a1630dc4978e800b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:57.908456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f0d7-8bea-497b-9edc-0fb268833137 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:57.908974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f0d7-8bea-497b-9edc-0fb268833137 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:57.908974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f0d7-8bea-497b-9edc-0fb268833137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:57.927261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-fa01f0d7-8bea-497b-9edc-0fb268833137 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:57.928456 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-fa01f0d7-8bea-497b-9edc-0fb268833137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:57.985438 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1328/2671] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:57.994230 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ae67-a411-4b6c-91d3-b4e3821211dc None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:57.994661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ae67-a411-4b6c-91d3-b4e3821211dc None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:57.994955 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ae67-a411-4b6c-91d3-b4e3821211dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.012807 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-2257ae67-a411-4b6c-91d3-b4e3821211dc None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:58.014024 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2257ae67-a411-4b6c-91d3-b4e3821211dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:58.023541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1344/2672] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:58.027969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f0d7-8bea-497b-9edc-0fb268833137 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:58.038455 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f0d7-8bea-497b-9edc-0fb268833137 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:58.044027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:58.044725 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.045018 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.045306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.046056 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:46:58.046368 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:58.048033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:58.060373 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1329/2673] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:46:58.064676 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257ae67-a411-4b6c-91d3-b4e3821211dc None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:58.074635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257ae67-a411-4b6c-91d3-b4e3821211dc None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:58.079664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f04c8-5eb1-4380-b790-b7184a2670b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:58.081249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f04c8-5eb1-4380-b790-b7184a2670b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.081249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f04c8-5eb1-4380-b790-b7184a2670b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.082006 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f04c8-5eb1-4380-b790-b7184a2670b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.082666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f04c8-5eb1-4380-b790-b7184a2670b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:58.084773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f04c8-5eb1-4380-b790-b7184a2670b4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:58.205478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1345/2674] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:58 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:46:58.209553 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:58.219659 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44da1-eca6-4d34-b341-028375b13529 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:58.277748 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef31bd-878c-4add-b65a-d02061137562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:58.278454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef31bd-878c-4add-b65a-d02061137562 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.278772 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef31bd-878c-4add-b65a-d02061137562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.279051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef31bd-878c-4add-b65a-d02061137562 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.279758 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef31bd-878c-4add-b65a-d02061137562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:58.281880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef31bd-878c-4add-b65a-d02061137562 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:58.364387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1330/2675] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:58 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:58.368377 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f04c8-5eb1-4380-b790-b7184a2670b4 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:58.379193 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f04c8-5eb1-4380-b790-b7184a2670b4 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:58.384123 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a22d8-7f6a-4c25-ae74-ac97e938304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:58.384791 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a22d8-7f6a-4c25-ae74-ac97e938304f admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.385079 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a22d8-7f6a-4c25-ae74-ac97e938304f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.385360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a22d8-7f6a-4c25-ae74-ac97e938304f admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.386137 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a22d8-7f6a-4c25-ae74-ac97e938304f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:58.387904 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a22d8-7f6a-4c25-ae74-ac97e938304f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:58.398686 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1346/2676] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:46:58.403193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef31bd-878c-4add-b65a-d02061137562 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:58.413953 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef31bd-878c-4add-b65a-d02061137562 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:58.418968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e46e7-d54b-4ae1-9c4c-f7be9ddbd262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:58.419680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e46e7-d54b-4ae1-9c4c-f7be9ddbd262 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.419966 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e46e7-d54b-4ae1-9c4c-f7be9ddbd262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.420250 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e46e7-d54b-4ae1-9c4c-f7be9ddbd262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.420989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e46e7-d54b-4ae1-9c4c-f7be9ddbd262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:58.422614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e46e7-d54b-4ae1-9c4c-f7be9ddbd262 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:58.433689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1331/2677] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:58.437669 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a22d8-7f6a-4c25-ae74-ac97e938304f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:58.447633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a22d8-7f6a-4c25-ae74-ac97e938304f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:58.452478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adca2f9-0cc9-42bc-a0b5-1d701f709c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:58.453350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adca2f9-0cc9-42bc-a0b5-1d701f709c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.453633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adca2f9-0cc9-42bc-a0b5-1d701f709c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.453914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adca2f9-0cc9-42bc-a0b5-1d701f709c2a admin admin] PATH_INFO: `/v3/projects/e50331f7e1b4432698462b908cae9b47/users/51f128aea3974140a0807c2a20dc4c73/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.469645 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adca2f9-0cc9-42bc-a0b5-1d701f709c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50331f7e1b4432698462b908cae9b47, user_id=51f128aea3974140a0807c2a20dc4c73, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:58.478742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adca2f9-0cc9-42bc-a0b5-1d701f709c2a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:58.570107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1347/2678] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:58 2022] PUT /identity/v3/projects/e50331f7e1b4432698462b908cae9b47/users/51f128aea3974140a0807c2a20dc4c73/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:46:58.580610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27cfc-c687-49ac-9156-5a28df0c67b2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.580899 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27cfc-c687-49ac-9156-5a28df0c67b2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.581209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27cfc-c687-49ac-9156-5a28df0c67b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.607925 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-7bb27cfc-c687-49ac-9156-5a28df0c67b2 None None] MFA Rules not processed for user `51f128aea3974140a0807c2a20dc4c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:58.609135 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-7bb27cfc-c687-49ac-9156-5a28df0c67b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:58.673181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1332/2679] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:46:58.678184 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adca2f9-0cc9-42bc-a0b5-1d701f709c2a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:58.742167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adca2f9-0cc9-42bc-a0b5-1d701f709c2a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:58.747339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c596-bbdf-419a-bb8e-571476ea820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:58.748012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c596-bbdf-419a-bb8e-571476ea820b admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.752563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c596-bbdf-419a-bb8e-571476ea820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.752563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c596-bbdf-419a-bb8e-571476ea820b admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.752563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7c596-bbdf-419a-bb8e-571476ea820b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:58.752563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7c596-bbdf-419a-bb8e-571476ea820b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:58.868044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1348/2680] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:58 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:58.872294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27cfc-c687-49ac-9156-5a28df0c67b2 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:58.883327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27cfc-c687-49ac-9156-5a28df0c67b2 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:58.940512 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e70664-ede1-4683-b6f7-dca21d660bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:58.941318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e70664-ede1-4683-b6f7-dca21d660bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:58.941463 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e70664-ede1-4683-b6f7-dca21d660bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:58.941743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e70664-ede1-4683-b6f7-dca21d660bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:58.942450 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e70664-ede1-4683-b6f7-dca21d660bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:58.944549 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e70664-ede1-4683-b6f7-dca21d660bf3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.032385 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1333/2681] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:58 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:59.036839 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c596-bbdf-419a-bb8e-571476ea820b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.048121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c596-bbdf-419a-bb8e-571476ea820b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.053479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6052b5a-a068-499c-a95c-3d8ddaaab8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.054127 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052b5a-a068-499c-a95c-3d8ddaaab8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.054412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052b5a-a068-499c-a95c-3d8ddaaab8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.054723 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6052b5a-a068-499c-a95c-3d8ddaaab8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.055452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6052b5a-a068-499c-a95c-3d8ddaaab8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.057092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6052b5a-a068-499c-a95c-3d8ddaaab8f6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.069867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1349/2682] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:59.073229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e70664-ede1-4683-b6f7-dca21d660bf3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.083400 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e70664-ede1-4683-b6f7-dca21d660bf3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.088314 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626ebcb-f528-4499-89a9-e09599816025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.088982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626ebcb-f528-4499-89a9-e09599816025 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.089274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626ebcb-f528-4499-89a9-e09599816025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.089554 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626ebcb-f528-4499-89a9-e09599816025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.090299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626ebcb-f528-4499-89a9-e09599816025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.091938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626ebcb-f528-4499-89a9-e09599816025 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.103259 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1334/2683] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:59.107800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6052b5a-a068-499c-a95c-3d8ddaaab8f6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.119975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6052b5a-a068-499c-a95c-3d8ddaaab8f6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.124683 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a81f-c45f-4875-9468-9d0a6810f75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.127080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a81f-c45f-4875-9468-9d0a6810f75a admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.127080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a81f-c45f-4875-9468-9d0a6810f75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.127080 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284a81f-c45f-4875-9468-9d0a6810f75a admin admin] PATH_INFO: `/v3/projects/fd11d94ba144406799b3adc0ab4f2b71/users/0c42e9229b9b4b15bbe281b8ea19b26b/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.142524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284a81f-c45f-4875-9468-9d0a6810f75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd11d94ba144406799b3adc0ab4f2b71, user_id=0c42e9229b9b4b15bbe281b8ea19b26b, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.145297 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284a81f-c45f-4875-9468-9d0a6810f75a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.260348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1350/2684] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:59 2022] PUT /identity/v3/projects/fd11d94ba144406799b3adc0ab4f2b71/users/0c42e9229b9b4b15bbe281b8ea19b26b/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:59.270294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb1ef-72f2-4f21-96df-9e2a324330f6 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.270640 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb1ef-72f2-4f21-96df-9e2a324330f6 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.271165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb1ef-72f2-4f21-96df-9e2a324330f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.302980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-585bb1ef-72f2-4f21-96df-9e2a324330f6 None None] MFA Rules not processed for user `0c42e9229b9b4b15bbe281b8ea19b26b`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:59.314310 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-585bb1ef-72f2-4f21-96df-9e2a324330f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:46:59.371469 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1335/2685] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:46:59.376155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a81f-c45f-4875-9468-9d0a6810f75a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.437711 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284a81f-c45f-4875-9468-9d0a6810f75a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.443169 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf156-9be9-4d31-ac5b-186dc2699d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.443921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf156-9be9-4d31-ac5b-186dc2699d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.449075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf156-9be9-4d31-ac5b-186dc2699d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.449075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf156-9be9-4d31-ac5b-186dc2699d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.449075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf156-9be9-4d31-ac5b-186dc2699d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.449075 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf156-9be9-4d31-ac5b-186dc2699d98 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.531749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1351/2686] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:46:59 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:59.538351 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bb1ef-72f2-4f21-96df-9e2a324330f6 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.549046 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bb1ef-72f2-4f21-96df-9e2a324330f6 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.604379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ec09b-d99b-4e30-bbcc-c0de0f8642da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.605336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec09b-d99b-4e30-bbcc-c0de0f8642da admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.605713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec09b-d99b-4e30-bbcc-c0de0f8642da admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.605989 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec09b-d99b-4e30-bbcc-c0de0f8642da admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.606729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ec09b-d99b-4e30-bbcc-c0de0f8642da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.608999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ec09b-d99b-4e30-bbcc-c0de0f8642da admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.696065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1336/2687] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:46:59 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:46:59.699947 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf156-9be9-4d31-ac5b-186dc2699d98 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.710954 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf156-9be9-4d31-ac5b-186dc2699d98 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.715789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34c47-5225-42ca-accc-822e76c32de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.716489 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34c47-5225-42ca-accc-822e76c32de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.716808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34c47-5225-42ca-accc-822e76c32de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.717100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34c47-5225-42ca-accc-822e76c32de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.717865 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34c47-5225-42ca-accc-822e76c32de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.719569 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34c47-5225-42ca-accc-822e76c32de9 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.730797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1352/2688] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:59.735226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ec09b-d99b-4e30-bbcc-c0de0f8642da admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.745247 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ec09b-d99b-4e30-bbcc-c0de0f8642da admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.749952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c161f-a3b5-42e1-8845-e965debd8785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.750798 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c161f-a3b5-42e1-8845-e965debd8785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.751086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c161f-a3b5-42e1-8845-e965debd8785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.751395 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c161f-a3b5-42e1-8845-e965debd8785 admin admin] PATH_INFO: `/v3/projects/2af043370f9b41d48f1b6515d77cde95/users/c86aeee8edeb44438e93ebcad7ed5e50/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.767113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c161f-a3b5-42e1-8845-e965debd8785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af043370f9b41d48f1b6515d77cde95, user_id=c86aeee8edeb44438e93ebcad7ed5e50, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.770518 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c161f-a3b5-42e1-8845-e965debd8785 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.826707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1337/2689] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:59 2022] PUT /identity/v3/projects/2af043370f9b41d48f1b6515d77cde95/users/c86aeee8edeb44438e93ebcad7ed5e50/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:59.830790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34c47-5225-42ca-accc-822e76c32de9 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.841180 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34c47-5225-42ca-accc-822e76c32de9 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.897869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21245f-e151-4c91-87e8-dd0a5c72d63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.898560 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21245f-e151-4c91-87e8-dd0a5c72d63a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.898859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21245f-e151-4c91-87e8-dd0a5c72d63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.899139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21245f-e151-4c91-87e8-dd0a5c72d63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.899872 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21245f-e151-4c91-87e8-dd0a5c72d63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.901468 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21245f-e151-4c91-87e8-dd0a5c72d63a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.911836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1353/2690] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:46:59.916588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c161f-a3b5-42e1-8845-e965debd8785 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:46:59.927988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c161f-a3b5-42e1-8845-e965debd8785 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:46:59.932783 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:46:59.933741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.934020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.934296 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] PATH_INFO: `/v3/projects/2af043370f9b41d48f1b6515d77cde95/users/c86aeee8edeb44438e93ebcad7ed5e50/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.936287 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af043370f9b41d48f1b6515d77cde95, user_id=c86aeee8edeb44438e93ebcad7ed5e50, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:46:59.939030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:46:59.949265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1338/2691] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:46:59 2022] PUT /identity/v3/projects/2af043370f9b41d48f1b6515d77cde95/users/c86aeee8edeb44438e93ebcad7ed5e50/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:46:59.960322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37603a2-decc-4daa-a9cb-b044d99c877c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:46:59.960987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37603a2-decc-4daa-a9cb-b044d99c877c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:46:59.961419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37603a2-decc-4daa-a9cb-b044d99c877c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:46:59.990618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d37603a2-decc-4daa-a9cb-b044d99c877c None None] MFA Rules not processed for user `c86aeee8edeb44438e93ebcad7ed5e50`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:46:59.991854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d37603a2-decc-4daa-a9cb-b044d99c877c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:00.062034 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1354/2692] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:00.072992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:00.075013 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:00.134618 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc395342-d34d-4c35-9f83-bc1cd8724a50 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:00.138275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3782f5-cfab-454b-8d6c-423d7a6269c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:00.138991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3782f5-cfab-454b-8d6c-423d7a6269c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:00.139284 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3782f5-cfab-454b-8d6c-423d7a6269c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:00.139560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3782f5-cfab-454b-8d6c-423d7a6269c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:00.148585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3782f5-cfab-454b-8d6c-423d7a6269c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:00.150746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3782f5-cfab-454b-8d6c-423d7a6269c9 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:00.164866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1339/2693] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:01.059166 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37603a2-decc-4daa-a9cb-b044d99c877c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:01.060571 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d37603a2-decc-4daa-a9cb-b044d99c877c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:01.072663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37603a2-decc-4daa-a9cb-b044d99c877c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:01.076286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:01.076914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:01.077196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:01.077472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:01.133487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:01.135044 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:01.144126 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1355/2694] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:05.874412 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3782f5-cfab-454b-8d6c-423d7a6269c9 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:05.883290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3782f5-cfab-454b-8d6c-423d7a6269c9 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:05.886875 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c96e00-d440-4616-8233-2cf6ef002d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:05.887544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96e00-d440-4616-8233-2cf6ef002d6c service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:05.887827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96e00-d440-4616-8233-2cf6ef002d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:05.888102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96e00-d440-4616-8233-2cf6ef002d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:05.943120 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c96e00-d440-4616-8233-2cf6ef002d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:05.944547 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c96e00-d440-4616-8233-2cf6ef002d6c service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:05.953718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1340/2695] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:06.073780 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:06.075269 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:06.150673 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219369a-c00d-4ede-8a8a-56c97aad7113 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:06.155562 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:06.156437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:06.156722 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:06.157002 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] PATH_INFO: `/v3/users/949b2bfae88f4e5b90324cfd4f0e3095` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:06.158208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=949b2bfae88f4e5b90324cfd4f0e3095)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:06.160215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:06.302303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949b2bfae88f4e5b90324cfd4f0e3095'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:06.309138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949b2bfae88f4e5b90324cfd4f0e3095'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:06.309819 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949b2bfae88f4e5b90324cfd4f0e3095'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:06.310426 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949b2bfae88f4e5b90324cfd4f0e3095'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:06.368492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949b2bfae88f4e5b90324cfd4f0e3095'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:06.386384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1356/2696] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:06 2022] DELETE /identity/v3/users/949b2bfae88f4e5b90324cfd4f0e3095 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:06.391104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ce5c-df07-4540-bee8-40828c7ddff1 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:06.391557 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ce5c-df07-4540-bee8-40828c7ddff1 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:06.391843 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623ce5c-df07-4540-bee8-40828c7ddff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:06.409433 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e623ce5c-df07-4540-bee8-40828c7ddff1 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:06.410689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e623ce5c-df07-4540-bee8-40828c7ddff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:06.468980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1341/2697] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:06.478793 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:06.480211 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:06.537046 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40256640-0480-4df2-854d-374ccfaa3616 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:06.540843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbd52a-5564-4e98-abf8-d6b651b44e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:06.541434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd52a-5564-4e98-abf8-d6b651b44e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:06.541728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd52a-5564-4e98-abf8-d6b651b44e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:06.542010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd52a-5564-4e98-abf8-d6b651b44e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:06.551455 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbd52a-5564-4e98-abf8-d6b651b44e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:06.552908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbd52a-5564-4e98-abf8-d6b651b44e6c service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:06.562506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1357/2698] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:06.970785 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623ce5c-df07-4540-bee8-40828c7ddff1 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:06.978290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e623ce5c-df07-4540-bee8-40828c7ddff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:06.986912 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623ce5c-df07-4540-bee8-40828c7ddff1 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:06.992597 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:06.993484 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:06.993769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:06.994055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] PATH_INFO: `/v3/projects/1b4c7d276bee4f1da0fb9dd0543665c8` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:06.995361 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4c7d276bee4f1da0fb9dd0543665c8)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:06.997707 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:07.101519 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4c7d276bee4f1da0fb9dd0543665c8', 'request_id': 'req-67a6d9f1-467e-47cc-b421-1c041180d4dd'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:07.168588 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4c7d276bee4f1da0fb9dd0543665c8', 'request_id': 'req-67a6d9f1-467e-47cc-b421-1c041180d4dd'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:07.174381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4c7d276bee4f1da0fb9dd0543665c8', 'request_id': 'req-67a6d9f1-467e-47cc-b421-1c041180d4dd'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:07.186480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] The token cache is being invalidate because project 1b4c7d276bee4f1da0fb9dd0543665c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:07.186807 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:07.187492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-67a6d9f1-467e-47cc-b421-1c041180d4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:07.191598 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1342/2699] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:06 2022] DELETE /identity/v3/projects/1b4c7d276bee4f1da0fb9dd0543665c8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:07.193978 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271666-38d1-4509-a5c6-2a638527a4da None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.194432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271666-38d1-4509-a5c6-2a638527a4da None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.194558 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3271666-38d1-4509-a5c6-2a638527a4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.212502 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b3271666-38d1-4509-a5c6-2a638527a4da None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:07.213757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b3271666-38d1-4509-a5c6-2a638527a4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:07.274035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1358/2700] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:07.281975 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cc5d-60b4-4d77-80e6-584034542ba9 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.282244 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cc5d-60b4-4d77-80e6-584034542ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.282528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cc5d-60b4-4d77-80e6-584034542ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.300942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-08a0cc5d-60b4-4d77-80e6-584034542ba9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:07.302161 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-08a0cc5d-60b4-4d77-80e6-584034542ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:07.310819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1343/2701] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:07.315056 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3271666-38d1-4509-a5c6-2a638527a4da None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:07.324973 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3271666-38d1-4509-a5c6-2a638527a4da None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:07.329698 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:07.330564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.330858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.331138 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.331880 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:47:07.332196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:07.333986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:07.348897 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1359/2702] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:47:07.350436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cc5d-60b4-4d77-80e6-584034542ba9 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:07.359987 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cc5d-60b4-4d77-80e6-584034542ba9 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:07.365827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074b75f-1911-45e8-b27e-ea4e2abc7d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:07.366515 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074b75f-1911-45e8-b27e-ea4e2abc7d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.366844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074b75f-1911-45e8-b27e-ea4e2abc7d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.367122 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074b75f-1911-45e8-b27e-ea4e2abc7d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.367820 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074b75f-1911-45e8-b27e-ea4e2abc7d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:07.369721 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074b75f-1911-45e8-b27e-ea4e2abc7d98 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:07.432736 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1344/2703] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:07 2022] POST /identity/v3/projects => generated 405 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:07.442433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:07.452593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0815552-5ed3-4d9e-ad9d-3f2ff143d148 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:07.508597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647904b-a011-4548-8ca2-5cd30420bedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:07.511472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647904b-a011-4548-8ca2-5cd30420bedd admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.511472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647904b-a011-4548-8ca2-5cd30420bedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.511472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647904b-a011-4548-8ca2-5cd30420bedd admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.511472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647904b-a011-4548-8ca2-5cd30420bedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:07.512431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647904b-a011-4548-8ca2-5cd30420bedd admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:07.580450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1360/2704] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:07 2022] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:07.585245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074b75f-1911-45e8-b27e-ea4e2abc7d98 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:07.595837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074b75f-1911-45e8-b27e-ea4e2abc7d98 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:07.600995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b4434-5d74-4b57-b7a5-4dfbfb46aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:07.601713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4434-5d74-4b57-b7a5-4dfbfb46aff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.601997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4434-5d74-4b57-b7a5-4dfbfb46aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.602271 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4434-5d74-4b57-b7a5-4dfbfb46aff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.603192 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b4434-5d74-4b57-b7a5-4dfbfb46aff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:07.604780 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b4434-5d74-4b57-b7a5-4dfbfb46aff7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:07.616107 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1345/2705] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:07.622805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647904b-a011-4548-8ca2-5cd30420bedd admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:07.633152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647904b-a011-4548-8ca2-5cd30420bedd admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:07.638021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc69dd-05a7-4baf-8fb6-2cd3cb7847d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:07.638737 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc69dd-05a7-4baf-8fb6-2cd3cb7847d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.639023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc69dd-05a7-4baf-8fb6-2cd3cb7847d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.639298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc69dd-05a7-4baf-8fb6-2cd3cb7847d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.640064 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc69dd-05a7-4baf-8fb6-2cd3cb7847d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:07.641668 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc69dd-05a7-4baf-8fb6-2cd3cb7847d2 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:07.654038 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1361/2706] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:07.663636 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b4434-5d74-4b57-b7a5-4dfbfb46aff7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:07.673608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b4434-5d74-4b57-b7a5-4dfbfb46aff7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:07.678252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab3ba5-7ced-4e26-97cc-5a19d72aae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:07.679155 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3ba5-7ced-4e26-97cc-5a19d72aae3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.679437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3ba5-7ced-4e26-97cc-5a19d72aae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.679712 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3ba5-7ced-4e26-97cc-5a19d72aae3b admin admin] PATH_INFO: `/v3/projects/b77a68e3d9fa490087f217194083328b/users/19d7d36c949544b7a6d230c8840e7034/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.696740 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab3ba5-7ced-4e26-97cc-5a19d72aae3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77a68e3d9fa490087f217194083328b, user_id=19d7d36c949544b7a6d230c8840e7034, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:07.700940 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab3ba5-7ced-4e26-97cc-5a19d72aae3b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:07.775136 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1346/2707] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:07 2022] PUT /identity/v3/projects/b77a68e3d9fa490087f217194083328b/users/19d7d36c949544b7a6d230c8840e7034/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:07.786150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038932b-20a6-4665-91da-32e85d5ed778 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.786446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038932b-20a6-4665-91da-32e85d5ed778 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.786772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038932b-20a6-4665-91da-32e85d5ed778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.813473 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-3038932b-20a6-4665-91da-32e85d5ed778 None None] MFA Rules not processed for user `19d7d36c949544b7a6d230c8840e7034`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:07.814719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3038932b-20a6-4665-91da-32e85d5ed778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:07.879757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1362/2708] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:07.884180 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab3ba5-7ced-4e26-97cc-5a19d72aae3b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:07.948301 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab3ba5-7ced-4e26-97cc-5a19d72aae3b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:07.953193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0876f6-f8cf-42d5-8af8-fbe9498efaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:07.953861 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0876f6-f8cf-42d5-8af8-fbe9498efaed admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:07.954207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0876f6-f8cf-42d5-8af8-fbe9498efaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:07.955429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0876f6-f8cf-42d5-8af8-fbe9498efaed admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:07.955429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0876f6-f8cf-42d5-8af8-fbe9498efaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:07.957379 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0876f6-f8cf-42d5-8af8-fbe9498efaed admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:08.056962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1347/2709] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:07 2022] POST /identity/v3/projects => generated 405 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:08.061086 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038932b-20a6-4665-91da-32e85d5ed778 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:08.071828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038932b-20a6-4665-91da-32e85d5ed778 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:08.134788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe79d-a147-4ace-bd5e-6dd07a08d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:08.134788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe79d-a147-4ace-bd5e-6dd07a08d0da admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:08.134788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe79d-a147-4ace-bd5e-6dd07a08d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:08.134788 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe79d-a147-4ace-bd5e-6dd07a08d0da admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:08.135237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbe79d-a147-4ace-bd5e-6dd07a08d0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:08.135237 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbe79d-a147-4ace-bd5e-6dd07a08d0da admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:08.230047 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1363/2710] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:08 2022] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:08.231497 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0876f6-f8cf-42d5-8af8-fbe9498efaed admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:08.242218 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0876f6-f8cf-42d5-8af8-fbe9498efaed admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:08.247128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c14b7-14cd-44a0-ab8f-e019a858a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:08.247808 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c14b7-14cd-44a0-ab8f-e019a858a320 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:08.248100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c14b7-14cd-44a0-ab8f-e019a858a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:08.248411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c14b7-14cd-44a0-ab8f-e019a858a320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:08.249151 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c14b7-14cd-44a0-ab8f-e019a858a320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:08.250779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c14b7-14cd-44a0-ab8f-e019a858a320 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:08.262333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1348/2711] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:08.266190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe79d-a147-4ace-bd5e-6dd07a08d0da admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:08.277176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe79d-a147-4ace-bd5e-6dd07a08d0da admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:08.281797 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db37b6-5834-4118-84e2-9725eaa20a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:08.282710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db37b6-5834-4118-84e2-9725eaa20a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:08.283000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db37b6-5834-4118-84e2-9725eaa20a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:08.283280 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db37b6-5834-4118-84e2-9725eaa20a08 admin admin] PATH_INFO: `/v3/projects/442ea66165cf42e3b6e062e36364664a/users/b816bcf0607d414ba4d2c0aaadb48321/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:08.298239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db37b6-5834-4118-84e2-9725eaa20a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442ea66165cf42e3b6e062e36364664a, user_id=b816bcf0607d414ba4d2c0aaadb48321, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:08.300966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db37b6-5834-4118-84e2-9725eaa20a08 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:08.380328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1364/2712] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:08 2022] PUT /identity/v3/projects/442ea66165cf42e3b6e062e36364664a/users/b816bcf0607d414ba4d2c0aaadb48321/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:08.384523 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c14b7-14cd-44a0-ab8f-e019a858a320 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:08.394389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c14b7-14cd-44a0-ab8f-e019a858a320 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:08.451194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd28ce0-8545-4a2f-be67-e2fd4dbb1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:08.451873 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd28ce0-8545-4a2f-be67-e2fd4dbb1ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:08.452169 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd28ce0-8545-4a2f-be67-e2fd4dbb1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:08.452452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd28ce0-8545-4a2f-be67-e2fd4dbb1ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:08.453193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd28ce0-8545-4a2f-be67-e2fd4dbb1ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:08.455015 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd28ce0-8545-4a2f-be67-e2fd4dbb1ec7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:08.465327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1349/2713] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:47:08.469765 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db37b6-5834-4118-84e2-9725eaa20a08 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:08.480594 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db37b6-5834-4118-84e2-9725eaa20a08 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:08.485290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:08.488306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:08.488306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:08.488306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] PATH_INFO: `/v3/projects/442ea66165cf42e3b6e062e36364664a/users/b816bcf0607d414ba4d2c0aaadb48321/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:08.488705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442ea66165cf42e3b6e062e36364664a, user_id=b816bcf0607d414ba4d2c0aaadb48321, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:08.491444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:08.501361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1365/2714] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:08 2022] PUT /identity/v3/projects/442ea66165cf42e3b6e062e36364664a/users/b816bcf0607d414ba4d2c0aaadb48321/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:08.512607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413acc-3152-404c-8baa-c70e9a2e27f2 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:08.512901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413acc-3152-404c-8baa-c70e9a2e27f2 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:08.519071 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c413acc-3152-404c-8baa-c70e9a2e27f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:08.540779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-2c413acc-3152-404c-8baa-c70e9a2e27f2 None None] MFA Rules not processed for user `b816bcf0607d414ba4d2c0aaadb48321`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:08.542003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2c413acc-3152-404c-8baa-c70e9a2e27f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:08.609233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1350/2715] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:08.619911 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:08.621651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:08.684141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4e991-ee11-4b56-8e79-bfcbe72bccc6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:08.687866 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:08.688543 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:08.688898 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:08.689182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:08.699002 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:08.700510 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:08.711906 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1366/2716] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:09.396610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c413acc-3152-404c-8baa-c70e9a2e27f2 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:09.456572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c413acc-3152-404c-8baa-c70e9a2e27f2 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:09.462603 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:09.463575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:09.463858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:09.464140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] PATH_INFO: `/v3/users/19d7d36c949544b7a6d230c8840e7034` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:09.465341 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d7d36c949544b7a6d230c8840e7034)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:09.467294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:09.621452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d7d36c949544b7a6d230c8840e7034'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:09.622017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d7d36c949544b7a6d230c8840e7034'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:09.628902 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d7d36c949544b7a6d230c8840e7034'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:09.629522 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d7d36c949544b7a6d230c8840e7034'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:09.674819 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:09.676361 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:09.687966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b933f8a-1f3e-4001-bdf7-4638bee8372e service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:09.688718 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-936f482c-e1b7-4888-b1db-76b8a1e1e359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d7d36c949544b7a6d230c8840e7034'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:09.691646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:09.694342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:09.694342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:09.694342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:09.695286 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:09.709248 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1351/2717] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:09 2022] DELETE /identity/v3/users/19d7d36c949544b7a6d230c8840e7034 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:09.713691 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890aca1d-51e2-433b-a85d-1d7f1ee6ed1b None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:09.713988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890aca1d-51e2-433b-a85d-1d7f1ee6ed1b None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:09.723125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890aca1d-51e2-433b-a85d-1d7f1ee6ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:09.731486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-890aca1d-51e2-433b-a85d-1d7f1ee6ed1b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:09.732794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-890aca1d-51e2-433b-a85d-1d7f1ee6ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:09.756525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:09.758013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:09.768111 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1367/2718] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:09.795316 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1352/2719] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:09.808374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:09.809953 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:09.873688 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f0792-3d40-41b1-9858-e3a833f5315b service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:09.922207 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890aca1d-51e2-433b-a85d-1d7f1ee6ed1b None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:09.923751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-890aca1d-51e2-433b-a85d-1d7f1ee6ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:09.925890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f023721-5132-4df0-8ac3-db8e736d30a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:09.926615 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f023721-5132-4df0-8ac3-db8e736d30a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:09.926931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f023721-5132-4df0-8ac3-db8e736d30a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:09.927215 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f023721-5132-4df0-8ac3-db8e736d30a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:09.936174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890aca1d-51e2-433b-a85d-1d7f1ee6ed1b None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:09.936486 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f023721-5132-4df0-8ac3-db8e736d30a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:09.937964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f023721-5132-4df0-8ac3-db8e736d30a4 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:09.941017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:09.941934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:09.942269 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:09.942600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] PATH_INFO: `/v3/users/51f128aea3974140a0807c2a20dc4c73` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:09.943888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f128aea3974140a0807c2a20dc4c73)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:09.945901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:09.948600 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1368/2720] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:10.156452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f128aea3974140a0807c2a20dc4c73'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.157106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f128aea3974140a0807c2a20dc4c73'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.164344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f128aea3974140a0807c2a20dc4c73'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.164997 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f128aea3974140a0807c2a20dc4c73'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.248693 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f128aea3974140a0807c2a20dc4c73'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.267616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1353/2721] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:09 2022] DELETE /identity/v3/users/51f128aea3974140a0807c2a20dc4c73 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:10.272830 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6cb2d-ef5f-40e5-a813-08765bcffe85 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:10.273106 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6cb2d-ef5f-40e5-a813-08765bcffe85 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:10.273384 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6cb2d-ef5f-40e5-a813-08765bcffe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:10.291580 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f8a6cb2d-ef5f-40e5-a813-08765bcffe85 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:10.292832 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f8a6cb2d-ef5f-40e5-a813-08765bcffe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:10.351208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1369/2722] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:10.353251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:10.357292 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:10.361701 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6cb2d-ef5f-40e5-a813-08765bcffe85 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:10.364349 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f8a6cb2d-ef5f-40e5-a813-08765bcffe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:10.371140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c420f1-9f0f-4446-a0db-00f7688e7516 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:10.377084 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:10.377941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:10.378224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:10.378530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] PATH_INFO: `/v3/projects/b77a68e3d9fa490087f217194083328b` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:10.379982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77a68e3d9fa490087f217194083328b)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:10.382590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:10.426404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6cb2d-ef5f-40e5-a813-08765bcffe85 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:10.430644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91244c6-ee81-41ea-9804-042e1b66fba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:10.431298 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91244c6-ee81-41ea-9804-042e1b66fba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:10.431585 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91244c6-ee81-41ea-9804-042e1b66fba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:10.431867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91244c6-ee81-41ea-9804-042e1b66fba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:10.440730 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91244c6-ee81-41ea-9804-042e1b66fba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:10.442174 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91244c6-ee81-41ea-9804-042e1b66fba3 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:10.452430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1370/2723] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:47:10.472312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77a68e3d9fa490087f217194083328b', 'request_id': 'req-5c948034-2f3d-4f65-9bc4-1181c1a1748a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.528663 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77a68e3d9fa490087f217194083328b', 'request_id': 'req-5c948034-2f3d-4f65-9bc4-1181c1a1748a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.534972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77a68e3d9fa490087f217194083328b', 'request_id': 'req-5c948034-2f3d-4f65-9bc4-1181c1a1748a'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.545941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] The token cache is being invalidate because project b77a68e3d9fa490087f217194083328b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:10.546241 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.546917 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.548534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1354/2724] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:10 2022] DELETE /identity/v3/projects/b77a68e3d9fa490087f217194083328b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:10.553143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91244c6-ee81-41ea-9804-042e1b66fba3 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:10.562980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91244c6-ee81-41ea-9804-042e1b66fba3 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:10.619374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:10.620255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:10.620538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:10.620816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] PATH_INFO: `/v3/users/b816bcf0607d414ba4d2c0aaadb48321` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:10.622013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b816bcf0607d414ba4d2c0aaadb48321)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:10.623982 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:10.765920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b816bcf0607d414ba4d2c0aaadb48321'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.772680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b816bcf0607d414ba4d2c0aaadb48321'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.773417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b816bcf0607d414ba4d2c0aaadb48321'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.774048 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b816bcf0607d414ba4d2c0aaadb48321'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.804687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:10.806273 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:10.819952 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c948034-2f3d-4f65-9bc4-1181c1a1748a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:10.824743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:10.825673 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:10.825967 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:10.826329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] PATH_INFO: `/v3/projects/e50331f7e1b4432698462b908cae9b47` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:10.827614 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50331f7e1b4432698462b908cae9b47)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:10.829581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:10.871370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b816bcf0607d414ba4d2c0aaadb48321'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:10.889236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1371/2725] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:10 2022] DELETE /identity/v3/users/b816bcf0607d414ba4d2c0aaadb48321 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:10.963224 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50331f7e1b4432698462b908cae9b47', 'request_id': 'req-da339abb-e01d-482f-8673-4b746f4944cf'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.014103 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50331f7e1b4432698462b908cae9b47', 'request_id': 'req-da339abb-e01d-482f-8673-4b746f4944cf'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.019730 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50331f7e1b4432698462b908cae9b47', 'request_id': 'req-da339abb-e01d-482f-8673-4b746f4944cf'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.031679 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] The token cache is being invalidate because project e50331f7e1b4432698462b908cae9b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:11.031969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.032589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.034177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1355/2726] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:10 2022] DELETE /identity/v3/projects/e50331f7e1b4432698462b908cae9b47 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:11.038236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:11.039680 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:11.113186 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac564fa4-7e4e-4a14-8683-b72ae9a5e341 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:11.174440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:11.175430 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.175721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.176002 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] PATH_INFO: `/v3/users/0c42e9229b9b4b15bbe281b8ea19b26b` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.177288 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c42e9229b9b4b15bbe281b8ea19b26b)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:11.179744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:11.336270 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:11.337765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:11.352211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339abb-e01d-482f-8673-4b746f4944cf admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:11.357026 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:11.357978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.358354 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.358744 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] PATH_INFO: `/v3/projects/442ea66165cf42e3b6e062e36364664a` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.367411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=442ea66165cf42e3b6e062e36364664a)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:11.367411 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:11.375012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c42e9229b9b4b15bbe281b8ea19b26b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.383602 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c42e9229b9b4b15bbe281b8ea19b26b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.384309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c42e9229b9b4b15bbe281b8ea19b26b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.384948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c42e9229b9b4b15bbe281b8ea19b26b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.453993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-067e8491-d959-449b-9d34-2640b481f909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c42e9229b9b4b15bbe281b8ea19b26b'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.471044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442ea66165cf42e3b6e062e36364664a', 'request_id': 'req-a946816d-d79d-46b8-b463-7121b7f8b930'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.471997 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1372/2727] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:11 2022] DELETE /identity/v3/users/0c42e9229b9b4b15bbe281b8ea19b26b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:11.534329 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442ea66165cf42e3b6e062e36364664a', 'request_id': 'req-a946816d-d79d-46b8-b463-7121b7f8b930'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.541478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442ea66165cf42e3b6e062e36364664a', 'request_id': 'req-a946816d-d79d-46b8-b463-7121b7f8b930'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.554303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] The token cache is being invalidate because project 442ea66165cf42e3b6e062e36364664a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:11.554625 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.555367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-a946816d-d79d-46b8-b463-7121b7f8b930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:11.556939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1356/2728] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:11 2022] DELETE /identity/v3/projects/442ea66165cf42e3b6e062e36364664a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:11.562912 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597193-77ee-4eae-9fa0-b3c33eca133f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.563690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597193-77ee-4eae-9fa0-b3c33eca133f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.563690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a597193-77ee-4eae-9fa0-b3c33eca133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.581644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4a597193-77ee-4eae-9fa0-b3c33eca133f None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:11.582922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4a597193-77ee-4eae-9fa0-b3c33eca133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:11.641651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1373/2729] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:11.649496 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2faacc-f60d-497c-902b-8bf659611816 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.649880 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2faacc-f60d-497c-902b-8bf659611816 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.654055 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2faacc-f60d-497c-902b-8bf659611816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.670336 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-5d2faacc-f60d-497c-902b-8bf659611816 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:11.671581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5d2faacc-f60d-497c-902b-8bf659611816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:11.683349 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1357/2730] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:11.685925 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597193-77ee-4eae-9fa0-b3c33eca133f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:11.696809 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a597193-77ee-4eae-9fa0-b3c33eca133f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:11.701789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:11.702476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.702802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.703083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.703826 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:47:11.704191 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:11.705802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:11.720378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1374/2731] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:47:11.725432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2faacc-f60d-497c-902b-8bf659611816 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:11.734615 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2faacc-f60d-497c-902b-8bf659611816 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:11.739369 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:11.740662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.740949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.741228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.741931 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:11.743857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:11.815930 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1358/2732] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:11 2022] POST /identity/v3/projects => generated 407 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:11.820456 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:11.830631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507bc6-f93f-43d7-9f5c-93f8857868df admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:11.869265 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:11.871723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:11.889331 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6bbde-0cdc-4887-88f3-03ae24ac0396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:11.890023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6bbde-0cdc-4887-88f3-03ae24ac0396 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.890313 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6bbde-0cdc-4887-88f3-03ae24ac0396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.890626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6bbde-0cdc-4887-88f3-03ae24ac0396 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.891345 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6bbde-0cdc-4887-88f3-03ae24ac0396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:11.893352 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6bbde-0cdc-4887-88f3-03ae24ac0396 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:11.954800 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1375/2733] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:11 2022] POST /identity/v3/users => generated 304 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:11.955798 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6bbde-0cdc-4887-88f3-03ae24ac0396 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:11.956732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce58e57-6307-4ff9-aeab-32fdd4f6957e admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:11.962503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:11.963631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.963771 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.964017 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] PATH_INFO: `/v3/projects/fd11d94ba144406799b3adc0ab4f2b71` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.965213 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd11d94ba144406799b3adc0ab4f2b71)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:11.967258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:11.968628 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6bbde-0cdc-4887-88f3-03ae24ac0396 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:11.975335 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c82e7-79f7-4641-8cde-542553d2d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:11.976008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c82e7-79f7-4641-8cde-542553d2d89c admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:11.976292 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c82e7-79f7-4641-8cde-542553d2d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:11.976572 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c82e7-79f7-4641-8cde-542553d2d89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:11.977342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c82e7-79f7-4641-8cde-542553d2d89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:11.979245 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c82e7-79f7-4641-8cde-542553d2d89c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:11.990253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1376/2734] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:47:11.994054 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c82e7-79f7-4641-8cde-542553d2d89c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.003786 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c82e7-79f7-4641-8cde-542553d2d89c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.008482 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae9ca-9bbf-4c46-a523-4d92491f55b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.009119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae9ca-9bbf-4c46-a523-4d92491f55b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.017511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae9ca-9bbf-4c46-a523-4d92491f55b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.017511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae9ca-9bbf-4c46-a523-4d92491f55b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.017511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ae9ca-9bbf-4c46-a523-4d92491f55b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.017511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ae9ca-9bbf-4c46-a523-4d92491f55b6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.022854 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1377/2735] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:12.027004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae9ca-9bbf-4c46-a523-4d92491f55b6 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.036252 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae9ca-9bbf-4c46-a523-4d92491f55b6 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.041590 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ba6cf-0e42-4e19-a2cf-809726faf9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.042467 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ba6cf-0e42-4e19-a2cf-809726faf9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.043658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ba6cf-0e42-4e19-a2cf-809726faf9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.043658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ba6cf-0e42-4e19-a2cf-809726faf9e3 admin admin] PATH_INFO: `/v3/projects/334fc49e71614cc4a8362eab82f3aa2f/users/2f680ec6e8014a6786f9f00e61c7ed51/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.057762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ba6cf-0e42-4e19-a2cf-809726faf9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334fc49e71614cc4a8362eab82f3aa2f, user_id=2f680ec6e8014a6786f9f00e61c7ed51, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.060440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ba6cf-0e42-4e19-a2cf-809726faf9e3 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.186983 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1378/2736] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:12 2022] PUT /identity/v3/projects/334fc49e71614cc4a8362eab82f3aa2f/users/2f680ec6e8014a6786f9f00e61c7ed51/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:12.195226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd11d94ba144406799b3adc0ab4f2b71', 'request_id': 'req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.197708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcd3a-9157-474f-bd82-cf7f92f67a94 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.198254 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcd3a-9157-474f-bd82-cf7f92f67a94 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.198428 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbcd3a-9157-474f-bd82-cf7f92f67a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.236472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a7bbcd3a-9157-474f-bd82-cf7f92f67a94 None None] MFA Rules not processed for user `2f680ec6e8014a6786f9f00e61c7ed51`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:12.237649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a7bbcd3a-9157-474f-bd82-cf7f92f67a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:12.260383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd11d94ba144406799b3adc0ab4f2b71', 'request_id': 'req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.266428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd11d94ba144406799b3adc0ab4f2b71', 'request_id': 'req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.278609 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] The token cache is being invalidate because project fd11d94ba144406799b3adc0ab4f2b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:12.278898 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.279530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.281084 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1359/2737] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:11 2022] DELETE /identity/v3/projects/fd11d94ba144406799b3adc0ab4f2b71 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:12.284962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.286260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:12.304412 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1379/2738] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:12.308871 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbcd3a-9157-474f-bd82-cf7f92f67a94 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.310188 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a7bbcd3a-9157-474f-bd82-cf7f92f67a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:12.349233 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874bf0b-57f3-4eaf-b096-bfcb562cd8de admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.354088 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.361409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.361409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.361409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] PATH_INFO: `/v3/users/c86aeee8edeb44438e93ebcad7ed5e50` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.361409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86aeee8edeb44438e93ebcad7ed5e50)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.361409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.373707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbcd3a-9157-474f-bd82-cf7f92f67a94 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.378398 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df72ce1-d9a3-40da-952e-ebcf3cadf753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.379142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df72ce1-d9a3-40da-952e-ebcf3cadf753 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.379427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df72ce1-d9a3-40da-952e-ebcf3cadf753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.379704 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df72ce1-d9a3-40da-952e-ebcf3cadf753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.380393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df72ce1-d9a3-40da-952e-ebcf3cadf753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.382858 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df72ce1-d9a3-40da-952e-ebcf3cadf753 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.495852 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1380/2739] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:12 2022] POST /identity/v3/projects => generated 409 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:12.499678 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df72ce1-d9a3-40da-952e-ebcf3cadf753 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.553312 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86aeee8edeb44438e93ebcad7ed5e50'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.554612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86aeee8edeb44438e93ebcad7ed5e50'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.561503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86aeee8edeb44438e93ebcad7ed5e50'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.561741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df72ce1-d9a3-40da-952e-ebcf3cadf753 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.562268 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86aeee8edeb44438e93ebcad7ed5e50'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.566481 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e793c30-03a4-4ebb-bb39-d0ad196a243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.567198 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793c30-03a4-4ebb-bb39-d0ad196a243d admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.567475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793c30-03a4-4ebb-bb39-d0ad196a243d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.567749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793c30-03a4-4ebb-bb39-d0ad196a243d admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.568969 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e793c30-03a4-4ebb-bb39-d0ad196a243d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.570905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e793c30-03a4-4ebb-bb39-d0ad196a243d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.614177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86aeee8edeb44438e93ebcad7ed5e50'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:12.631981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1360/2740] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:12 2022] DELETE /identity/v3/users/c86aeee8edeb44438e93ebcad7ed5e50 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:12.649751 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1381/2741] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:12 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:12.654091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.655632 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:12.720360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb7127-e59b-4a9b-bd0f-8b1a0330ca6b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.725115 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e69da-bc81-4609-87c7-9b5450bf7139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.725782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e69da-bc81-4609-87c7-9b5450bf7139 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.726072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e69da-bc81-4609-87c7-9b5450bf7139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.726354 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e69da-bc81-4609-87c7-9b5450bf7139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.727202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e69da-bc81-4609-87c7-9b5450bf7139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.728729 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e69da-bc81-4609-87c7-9b5450bf7139 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.738650 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1361/2742] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:47:12.743315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e793c30-03a4-4ebb-bb39-d0ad196a243d admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.753281 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e793c30-03a4-4ebb-bb39-d0ad196a243d admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.758477 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863cc2-e355-4a0b-aa01-b199ece8ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.759378 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863cc2-e355-4a0b-aa01-b199ece8ecdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.759661 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863cc2-e355-4a0b-aa01-b199ece8ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.759932 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863cc2-e355-4a0b-aa01-b199ece8ecdb admin admin] PATH_INFO: `/v3/projects/b25cd521ca044e3badefdc5904213c6b/users/52cd8970ed2f4f7b9a875fd227e35bc4/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.774318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0863cc2-e355-4a0b-aa01-b199ece8ecdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25cd521ca044e3badefdc5904213c6b, user_id=52cd8970ed2f4f7b9a875fd227e35bc4, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.777277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0863cc2-e355-4a0b-aa01-b199ece8ecdb admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.834728 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1382/2743] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:12 2022] PUT /identity/v3/projects/b25cd521ca044e3badefdc5904213c6b/users/52cd8970ed2f4f7b9a875fd227e35bc4/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:12.842838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e69da-bc81-4609-87c7-9b5450bf7139 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.855174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e69da-bc81-4609-87c7-9b5450bf7139 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.911998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583a399-5eb5-4941-87b3-e7bcd388f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.912797 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a399-5eb5-4941-87b3-e7bcd388f895 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.913084 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a399-5eb5-4941-87b3-e7bcd388f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.913478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a399-5eb5-4941-87b3-e7bcd388f895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.914211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583a399-5eb5-4941-87b3-e7bcd388f895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.915844 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583a399-5eb5-4941-87b3-e7bcd388f895 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.926260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1362/2744] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 28 16:47:12.930900 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863cc2-e355-4a0b-aa01-b199ece8ecdb admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:12.941380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863cc2-e355-4a0b-aa01-b199ece8ecdb admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:12.946690 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:12.948901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.948901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.948901 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] PATH_INFO: `/v3/projects/b25cd521ca044e3badefdc5904213c6b/users/52cd8970ed2f4f7b9a875fd227e35bc4/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:12.950146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25cd521ca044e3badefdc5904213c6b, user_id=52cd8970ed2f4f7b9a875fd227e35bc4, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:12.952883 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:12.963326 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1383/2745] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:12 2022] PUT /identity/v3/projects/b25cd521ca044e3badefdc5904213c6b/users/52cd8970ed2f4f7b9a875fd227e35bc4/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:12.974865 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab5b8-eb3b-46d8-b688-75e794cc8eec None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:12.975179 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab5b8-eb3b-46d8-b688-75e794cc8eec None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:12.975459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab5b8-eb3b-46d8-b688-75e794cc8eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.001664 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-4f6ab5b8-eb3b-46d8-b688-75e794cc8eec None None] MFA Rules not processed for user `52cd8970ed2f4f7b9a875fd227e35bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:13.002886 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4f6ab5b8-eb3b-46d8-b688-75e794cc8eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:13.027759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.032348 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:13.087529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1363/2746] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:13.099117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab5b8-eb3b-46d8-b688-75e794cc8eec None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.103282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4f6ab5b8-eb3b-46d8-b688-75e794cc8eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:13.104429 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b74f8-89c5-481e-a42c-2558d8f5d572 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.109189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.110051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.110337 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.110647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] PATH_INFO: `/v3/projects/2af043370f9b41d48f1b6515d77cde95` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.111849 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af043370f9b41d48f1b6515d77cde95)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.113773 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.157051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab5b8-eb3b-46d8-b688-75e794cc8eec None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.161322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b9b27-f01f-49a2-b752-b9ec09aef790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.162488 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9b27-f01f-49a2-b752-b9ec09aef790 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.162809 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9b27-f01f-49a2-b752-b9ec09aef790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.163100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b9b27-f01f-49a2-b752-b9ec09aef790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.172589 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b9b27-f01f-49a2-b752-b9ec09aef790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.174054 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b9b27-f01f-49a2-b752-b9ec09aef790 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.184493 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1364/2747] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:47:13.240916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af043370f9b41d48f1b6515d77cde95', 'request_id': 'req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:13.340273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af043370f9b41d48f1b6515d77cde95', 'request_id': 'req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:13.346145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af043370f9b41d48f1b6515d77cde95', 'request_id': 'req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:13.357810 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] The token cache is being invalidate because project 2af043370f9b41d48f1b6515d77cde95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:13.358105 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:13.358831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-a43bbc56-d79d-4e5e-b2c0-010ccc4ac7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:13.360417 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1384/2748] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:13 2022] DELETE /identity/v3/projects/2af043370f9b41d48f1b6515d77cde95 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:13.367340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd857-d153-4cc6-8a15-3bd09be3197c None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.371545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd857-d153-4cc6-8a15-3bd09be3197c None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.371545 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd857-d153-4cc6-8a15-3bd09be3197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.385830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-e2fcd857-d153-4cc6-8a15-3bd09be3197c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:13.387129 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e2fcd857-d153-4cc6-8a15-3bd09be3197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:13.445132 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1365/2749] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:13.453756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e96cb8-9da7-4c61-93ba-2c5e9c8efafb None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.454048 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e96cb8-9da7-4c61-93ba-2c5e9c8efafb None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.454332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e96cb8-9da7-4c61-93ba-2c5e9c8efafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.472992 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-52e96cb8-9da7-4c61-93ba-2c5e9c8efafb None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:13.474232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-52e96cb8-9da7-4c61-93ba-2c5e9c8efafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:13.483232 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1385/2750] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:13.487668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd857-d153-4cc6-8a15-3bd09be3197c None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.497280 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd857-d153-4cc6-8a15-3bd09be3197c None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.501962 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.502653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.502942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.503220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.504008 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:47:13.504321 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.506045 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.522938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1366/2751] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:47:13.524000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e96cb8-9da7-4c61-93ba-2c5e9c8efafb None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.526964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.528737 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:13.534059 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e96cb8-9da7-4c61-93ba-2c5e9c8efafb None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.539644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314f9e-c781-47a4-a3a3-f6539d51a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.540306 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314f9e-c781-47a4-a3a3-f6539d51a95b admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.540597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314f9e-c781-47a4-a3a3-f6539d51a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.540876 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314f9e-c781-47a4-a3a3-f6539d51a95b admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.541564 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02314f9e-c781-47a4-a3a3-f6539d51a95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.543532 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02314f9e-c781-47a4-a3a3-f6539d51a95b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.585478 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55291d39-78b6-4da9-abe4-b7dfe1e7ddb0 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.589194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.589833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.590140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.590417 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.592227 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:13.607626 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1386/2752] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:13 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:13.608633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314f9e-c781-47a4-a3a3-f6539d51a95b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.650249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.652011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.660949 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1367/2753] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:47:13.670663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314f9e-c781-47a4-a3a3-f6539d51a95b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.675563 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803b533-73ef-480e-928b-107d9bd1e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.676121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803b533-73ef-480e-928b-107d9bd1e971 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.676432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803b533-73ef-480e-928b-107d9bd1e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.676710 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803b533-73ef-480e-928b-107d9bd1e971 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.677440 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803b533-73ef-480e-928b-107d9bd1e971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.679387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803b533-73ef-480e-928b-107d9bd1e971 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.740530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1387/2754] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:13 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:13.744702 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.755437 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffd65a-9352-4764-b08f-bd0db0fca780 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.760138 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af798a9a-9e0c-45a2-923f-8806e791139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.760800 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af798a9a-9e0c-45a2-923f-8806e791139d admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.761089 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af798a9a-9e0c-45a2-923f-8806e791139d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.764038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af798a9a-9e0c-45a2-923f-8806e791139d admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.764038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af798a9a-9e0c-45a2-923f-8806e791139d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.764038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af798a9a-9e0c-45a2-923f-8806e791139d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.777476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1368/2755] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:13.778905 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803b533-73ef-480e-928b-107d9bd1e971 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.789339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803b533-73ef-480e-928b-107d9bd1e971 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.794129 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f03aa8-5c96-45c5-aed0-02e6689891c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.794828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03aa8-5c96-45c5-aed0-02e6689891c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.795120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03aa8-5c96-45c5-aed0-02e6689891c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.795402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f03aa8-5c96-45c5-aed0-02e6689891c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.796136 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f03aa8-5c96-45c5-aed0-02e6689891c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.797768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f03aa8-5c96-45c5-aed0-02e6689891c4 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.807805 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1388/2756] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:13.811980 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af798a9a-9e0c-45a2-923f-8806e791139d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:13.822542 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af798a9a-9e0c-45a2-923f-8806e791139d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:13.827465 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc1c6-7807-45ba-be39-674ec37b19d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:13.828356 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc1c6-7807-45ba-be39-674ec37b19d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.828647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc1c6-7807-45ba-be39-674ec37b19d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.828950 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc1c6-7807-45ba-be39-674ec37b19d7 admin admin] PATH_INFO: `/v3/projects/ad4bfeb2e3f5418bb9d84dcb99035642/users/e0b79631cfcb455ba6974255df14e2d7/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.845581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dc1c6-7807-45ba-be39-674ec37b19d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4bfeb2e3f5418bb9d84dcb99035642, user_id=e0b79631cfcb455ba6974255df14e2d7, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:13.848347 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9dc1c6-7807-45ba-be39-674ec37b19d7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:13.928494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1369/2757] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:13 2022] PUT /identity/v3/projects/ad4bfeb2e3f5418bb9d84dcb99035642/users/e0b79631cfcb455ba6974255df14e2d7/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:13.939714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd4ac-d9cc-4fe5-adc0-42a9ddb91069 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:13.940209 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd4ac-d9cc-4fe5-adc0-42a9ddb91069 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:13.940320 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd4ac-d9cc-4fe5-adc0-42a9ddb91069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:13.968161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-936cd4ac-d9cc-4fe5-adc0-42a9ddb91069 None None] MFA Rules not processed for user `e0b79631cfcb455ba6974255df14e2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:13.969409 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-936cd4ac-d9cc-4fe5-adc0-42a9ddb91069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:14.033617 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1389/2758] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:14.038097 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc1c6-7807-45ba-be39-674ec37b19d7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:14.100884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc1c6-7807-45ba-be39-674ec37b19d7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:14.105995 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e0156-44fb-4ee6-af2b-a19380ea2330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:14.113454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0156-44fb-4ee6-af2b-a19380ea2330 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.113454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0156-44fb-4ee6-af2b-a19380ea2330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.113454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0156-44fb-4ee6-af2b-a19380ea2330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.113454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e0156-44fb-4ee6-af2b-a19380ea2330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:14.113454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e0156-44fb-4ee6-af2b-a19380ea2330 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:14.170294 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1370/2759] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:14 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:14.174161 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cd4ac-d9cc-4fe5-adc0-42a9ddb91069 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:14.185951 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cd4ac-d9cc-4fe5-adc0-42a9ddb91069 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:14.244323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b10e4-9f3b-4445-a312-282cdd4dc46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:14.245022 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b10e4-9f3b-4445-a312-282cdd4dc46a admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.245309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b10e4-9f3b-4445-a312-282cdd4dc46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.246400 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b10e4-9f3b-4445-a312-282cdd4dc46a admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.247195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b10e4-9f3b-4445-a312-282cdd4dc46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:14.249182 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b10e4-9f3b-4445-a312-282cdd4dc46a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:14.337446 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1390/2760] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:14 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:14.338695 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e0156-44fb-4ee6-af2b-a19380ea2330 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:14.348866 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e0156-44fb-4ee6-af2b-a19380ea2330 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:14.353551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb45729-1945-4ef2-a565-f476abb0d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:14.354212 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb45729-1945-4ef2-a565-f476abb0d980 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.354495 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb45729-1945-4ef2-a565-f476abb0d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.354827 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb45729-1945-4ef2-a565-f476abb0d980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.355616 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb45729-1945-4ef2-a565-f476abb0d980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:14.357502 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb45729-1945-4ef2-a565-f476abb0d980 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:14.371639 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1371/2761] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:14.372827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b10e4-9f3b-4445-a312-282cdd4dc46a admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:14.383258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b10e4-9f3b-4445-a312-282cdd4dc46a admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:14.388267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d528-0b65-4ee3-8e5a-40a68420857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:14.389316 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d528-0b65-4ee3-8e5a-40a68420857b admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.389663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d528-0b65-4ee3-8e5a-40a68420857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.390008 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d528-0b65-4ee3-8e5a-40a68420857b admin admin] PATH_INFO: `/v3/projects/04ba354b03bb4910bab3a0752f10f126/users/6cb4cee3bbba494494b864f457291309/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.405202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703d528-0b65-4ee3-8e5a-40a68420857b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ba354b03bb4910bab3a0752f10f126, user_id=6cb4cee3bbba494494b864f457291309, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:14.407907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703d528-0b65-4ee3-8e5a-40a68420857b admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:14.460271 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1391/2762] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:14 2022] PUT /identity/v3/projects/04ba354b03bb4910bab3a0752f10f126/users/6cb4cee3bbba494494b864f457291309/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:14.464302 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb45729-1945-4ef2-a565-f476abb0d980 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:14.474436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb45729-1945-4ef2-a565-f476abb0d980 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:14.530086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e40f22-42b8-431b-8bd3-6fdff7b7b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:14.530814 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e40f22-42b8-431b-8bd3-6fdff7b7b132 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.531101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e40f22-42b8-431b-8bd3-6fdff7b7b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.531381 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e40f22-42b8-431b-8bd3-6fdff7b7b132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.532111 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e40f22-42b8-431b-8bd3-6fdff7b7b132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:14.533819 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e40f22-42b8-431b-8bd3-6fdff7b7b132 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:14.544573 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1372/2763] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:14.548664 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d528-0b65-4ee3-8e5a-40a68420857b admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:14.560537 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d528-0b65-4ee3-8e5a-40a68420857b admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:14.565295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:14.566202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.566488 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.571530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] PATH_INFO: `/v3/projects/04ba354b03bb4910bab3a0752f10f126/users/6cb4cee3bbba494494b864f457291309/roles/a21c72e160dd47dd8fd580bc6794a84c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.571530 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ba354b03bb4910bab3a0752f10f126, user_id=6cb4cee3bbba494494b864f457291309, role_id=a21c72e160dd47dd8fd580bc6794a84c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:14.571733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:14.581576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1392/2764] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:14 2022] PUT /identity/v3/projects/04ba354b03bb4910bab3a0752f10f126/users/6cb4cee3bbba494494b864f457291309/roles/a21c72e160dd47dd8fd580bc6794a84c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:14.591934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7eeb2-3f53-4c84-a4a5-a13cbf3d29ef None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.592430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7eeb2-3f53-4c84-a4a5-a13cbf3d29ef None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.592528 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7eeb2-3f53-4c84-a4a5-a13cbf3d29ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.619176 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-17c7eeb2-3f53-4c84-a4a5-a13cbf3d29ef None None] MFA Rules not processed for user `6cb4cee3bbba494494b864f457291309`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:14.620385 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-17c7eeb2-3f53-4c84-a4a5-a13cbf3d29ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:14.688432 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1373/2765] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:14.699472 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:14.701163 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:14.759817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391fc35-8ab4-4e54-a60d-b4067b73a350 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:14.763671 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86441f-9665-4acd-a772-4a0f2f43dbfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:14.764322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86441f-9665-4acd-a772-4a0f2f43dbfa service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.764611 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86441f-9665-4acd-a772-4a0f2f43dbfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.764889 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86441f-9665-4acd-a772-4a0f2f43dbfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.774010 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86441f-9665-4acd-a772-4a0f2f43dbfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:14.775490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86441f-9665-4acd-a772-4a0f2f43dbfa service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:14.785437 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1393/2766] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:14.883579 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7eeb2-3f53-4c84-a4a5-a13cbf3d29ef None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:14.891991 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7eeb2-3f53-4c84-a4a5-a13cbf3d29ef None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:14.895754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:14.896974 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:14.897249 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:14.897489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:14.953787 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:14.955333 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:14.965229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1374/2767] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:24.454980 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120620-d445-4d87-bf9a-eff621870a81 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:24.455464 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120620-d445-4d87-bf9a-eff621870a81 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:24.459427 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120620-d445-4d87-bf9a-eff621870a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:24.479274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-c6120620-d445-4d87-bf9a-eff621870a81 None None] MFA Rules not processed for user `3b3b7cf50b844d94948110080a7eaed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:24.480499 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c6120620-d445-4d87-bf9a-eff621870a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:24.535431 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1394/2768] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:24.840276 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:24.841802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:24.897686 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505b32-a106-442f-94f4-f3e80d7c0481 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:24.901344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:24.902240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:24.902530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:24.902838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:24.904623 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:24.914602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:24.916041 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:24.924251 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1375/2769] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:28.654693 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120620-d445-4d87-bf9a-eff621870a81 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:28.654693 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-c6120620-d445-4d87-bf9a-eff621870a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:28.680743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:28.690226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120620-d445-4d87-bf9a-eff621870a81 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:28.695733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:28.699933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:28.699933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:28.699933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] PATH_INFO: `/v3/users/2f680ec6e8014a6786f9f00e61c7ed51` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:28.699933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f680ec6e8014a6786f9f00e61c7ed51)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:28.739083 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:28.739206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f7f6e-1d89-4323-a3a5-5eb74f5707f4 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:28.739206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:28.739206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:28.739206 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:28.739587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] PATH_INFO: `/v3/users/e0b79631cfcb455ba6974255df14e2d7` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:28.739587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b79631cfcb455ba6974255df14e2d7)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:28.739587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:28.925546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f680ec6e8014a6786f9f00e61c7ed51'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:28.932857 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f680ec6e8014a6786f9f00e61c7ed51'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:28.933525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f680ec6e8014a6786f9f00e61c7ed51'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:28.934175 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f680ec6e8014a6786f9f00e61c7ed51'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:28.957759 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b79631cfcb455ba6974255df14e2d7'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:28.958409 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b79631cfcb455ba6974255df14e2d7'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:28.965066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b79631cfcb455ba6974255df14e2d7'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:28.965687 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b79631cfcb455ba6974255df14e2d7'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:29.020520 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6092abca-6dc1-4642-b24b-ee509f3e46d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f680ec6e8014a6786f9f00e61c7ed51'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:29.040001 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1395/2770] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:28 2022] DELETE /identity/v3/users/2f680ec6e8014a6786f9f00e61c7ed51 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:29.048839 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c1fa-edcf-4b30-8866-43411c664e7b None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:29.049249 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c1fa-edcf-4b30-8866-43411c664e7b None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:29.050045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29c1fa-edcf-4b30-8866-43411c664e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:29.071153 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-0d29c1fa-edcf-4b30-8866-43411c664e7b None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:29.072838 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0d29c1fa-edcf-4b30-8866-43411c664e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:29.077486 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-e9c73107-44f6-4cd5-a809-2f1152afbc66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b79631cfcb455ba6974255df14e2d7'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:29.110202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1376/2771] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:28 2022] DELETE /identity/v3/users/e0b79631cfcb455ba6974255df14e2d7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:29.115413 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376815-8568-4fb8-841f-fbe1719afd22 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:29.116500 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376815-8568-4fb8-841f-fbe1719afd22 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:29.116954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df376815-8568-4fb8-841f-fbe1719afd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:29.143079 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-df376815-8568-4fb8-841f-fbe1719afd22 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:29.144943 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-df376815-8568-4fb8-841f-fbe1719afd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:29.145290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1396/2772] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:29.157309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29c1fa-edcf-4b30-8866-43411c664e7b None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:29.158878 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0d29c1fa-edcf-4b30-8866-43411c664e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:29.214765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1377/2773] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:29.226983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df376815-8568-4fb8-841f-fbe1719afd22 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:29.227588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29c1fa-edcf-4b30-8866-43411c664e7b None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:29.287093 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:29.288362 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:29.288655 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:29.288937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:29.289544 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df376815-8568-4fb8-841f-fbe1719afd22 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:29.293243 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:29.293900 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:29.294194 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:29.294477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:29.299078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:29.300827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:29.304359 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:29.306085 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:29.312856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1397/2774] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:47:29.316066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1378/2775] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:29.844632 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:29.846202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:29.863202 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9d36f-02df-4793-9e08-65c50d6e5331 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:29.864350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:29.866779 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:29.876223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:29.877739 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:29.878262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:29.878869 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] PATH_INFO: `/v3/projects/334fc49e71614cc4a8362eab82f3aa2f` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:29.880647 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334fc49e71614cc4a8362eab82f3aa2f)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:29.883607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:29.887006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562946-5e1f-4a1b-9c80-0341dbaf115d service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:29.893392 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:29.893945 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:29.894842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:29.895141 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] PATH_INFO: `/v3/projects/ad4bfeb2e3f5418bb9d84dcb99035642` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:29.898066 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4bfeb2e3f5418bb9d84dcb99035642)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:29.900911 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:30.020453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4bfeb2e3f5418bb9d84dcb99035642', 'request_id': 'req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.040785 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334fc49e71614cc4a8362eab82f3aa2f', 'request_id': 'req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.071262 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4bfeb2e3f5418bb9d84dcb99035642', 'request_id': 'req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.077594 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4bfeb2e3f5418bb9d84dcb99035642', 'request_id': 'req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.090181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] The token cache is being invalidate because project ad4bfeb2e3f5418bb9d84dcb99035642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:30.090476 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.091165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.092787 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1379/2776] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:29 2022] DELETE /identity/v3/projects/ad4bfeb2e3f5418bb9d84dcb99035642 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:30.097044 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:30.098738 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:30.128895 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334fc49e71614cc4a8362eab82f3aa2f', 'request_id': 'req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.136330 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334fc49e71614cc4a8362eab82f3aa2f', 'request_id': 'req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.148946 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] The token cache is being invalidate because project 334fc49e71614cc4a8362eab82f3aa2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:30.149538 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.150386 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.152592 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1398/2777] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:29 2022] DELETE /identity/v3/projects/334fc49e71614cc4a8362eab82f3aa2f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:30.156334 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:30.157721 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:30.168245 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572b13c-5a76-42a6-9cf2-2cd3b98a66bc admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:30.227525 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba251e-7c1c-45a2-a2fd-7eb56694eb87 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:30.228848 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:30.229826 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:30.230178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:30.230517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] PATH_INFO: `/v3/users/6cb4cee3bbba494494b864f457291309` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:30.231876 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb4cee3bbba494494b864f457291309)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:30.232649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:30.233524 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:30.233812 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:30.234062 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:30.234164 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] PATH_INFO: `/v3/users/52cd8970ed2f4f7b9a875fd227e35bc4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:30.235318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52cd8970ed2f4f7b9a875fd227e35bc4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:30.237478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:30.410634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb4cee3bbba494494b864f457291309'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.411492 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb4cee3bbba494494b864f457291309'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.419095 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb4cee3bbba494494b864f457291309'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.422555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb4cee3bbba494494b864f457291309'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.427802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52cd8970ed2f4f7b9a875fd227e35bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.435116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52cd8970ed2f4f7b9a875fd227e35bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.435801 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52cd8970ed2f4f7b9a875fd227e35bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.436407 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52cd8970ed2f4f7b9a875fd227e35bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.487968 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb4cee3bbba494494b864f457291309'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.506222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1380/2778] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:30 2022] DELETE /identity/v3/users/6cb4cee3bbba494494b864f457291309 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:30.568195 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52cd8970ed2f4f7b9a875fd227e35bc4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:30.586816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1399/2779] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:30 2022] DELETE /identity/v3/users/52cd8970ed2f4f7b9a875fd227e35bc4 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:30.947209 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:30.949166 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:31.024477 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d49dd-b2e3-4a0e-aa25-57c206d77d58 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.080157 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.081031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.081313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.081590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] PATH_INFO: `/v3/projects/04ba354b03bb4910bab3a0752f10f126` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.082813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ba354b03bb4910bab3a0752f10f126)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.085288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.106916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:31.109540 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:31.122192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33807de7-f137-438a-84f7-92c096921d8f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.127573 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.128755 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.129051 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.129342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] PATH_INFO: `/v3/projects/b25cd521ca044e3badefdc5904213c6b` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.130741 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25cd521ca044e3badefdc5904213c6b)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.143236 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.202946 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ba354b03bb4910bab3a0752f10f126', 'request_id': 'req-2bc7015c-3ce3-4bb0-842b-15d51a29d436'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.316374 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25cd521ca044e3badefdc5904213c6b', 'request_id': 'req-24677162-4d8e-4b66-91fc-5f4035d72999'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.328031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ba354b03bb4910bab3a0752f10f126', 'request_id': 'req-2bc7015c-3ce3-4bb0-842b-15d51a29d436'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.339352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ba354b03bb4910bab3a0752f10f126', 'request_id': 'req-2bc7015c-3ce3-4bb0-842b-15d51a29d436'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.345038 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] The token cache is being invalidate because project 04ba354b03bb4910bab3a0752f10f126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:31.345331 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.345955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-2bc7015c-3ce3-4bb0-842b-15d51a29d436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.347551 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1381/2780] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:30 2022] DELETE /identity/v3/projects/04ba354b03bb4910bab3a0752f10f126 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:31.352285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab31bcc-a7b6-4922-9084-babb65596801 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.352574 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab31bcc-a7b6-4922-9084-babb65596801 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.352858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab31bcc-a7b6-4922-9084-babb65596801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.371505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-0ab31bcc-a7b6-4922-9084-babb65596801 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:31.372890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-0ab31bcc-a7b6-4922-9084-babb65596801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:31.437109 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25cd521ca044e3badefdc5904213c6b', 'request_id': 'req-24677162-4d8e-4b66-91fc-5f4035d72999'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.447886 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25cd521ca044e3badefdc5904213c6b', 'request_id': 'req-24677162-4d8e-4b66-91fc-5f4035d72999'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.456894 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1382/2781] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:31.461326 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1269-098a-49b4-b0a9-bd00fce5e21d None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.461662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1269-098a-49b4-b0a9-bd00fce5e21d None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.461947 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1269-098a-49b4-b0a9-bd00fce5e21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.471511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] The token cache is being invalidate because project b25cd521ca044e3badefdc5904213c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:31.471816 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.472488 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-24677162-4d8e-4b66-91fc-5f4035d72999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:31.480705 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1400/2782] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:31 2022] DELETE /identity/v3/projects/b25cd521ca044e3badefdc5904213c6b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:31.489347 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500868e3-6c58-4dec-adfe-9a1d415648be None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.489636 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500868e3-6c58-4dec-adfe-9a1d415648be None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.498365 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500868e3-6c58-4dec-adfe-9a1d415648be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.498813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-03ad1269-098a-49b4-b0a9-bd00fce5e21d None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:31.498813 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-03ad1269-098a-49b4-b0a9-bd00fce5e21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:31.509202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1383/2783] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:31.512979 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1269-098a-49b4-b0a9-bd00fce5e21d None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:31.515967 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-500868e3-6c58-4dec-adfe-9a1d415648be None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:31.517205 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-500868e3-6c58-4dec-adfe-9a1d415648be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:31.523941 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1269-098a-49b4-b0a9-bd00fce5e21d None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.525907 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1401/2784] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:31.534226 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.535462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421cfa-3c32-4c2f-89c5-76e5480a35c3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.536175 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.536534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.536882 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421cfa-3c32-4c2f-89c5-76e5480a35c3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.537225 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.537583 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421cfa-3c32-4c2f-89c5-76e5480a35c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.538399 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:47:31.539914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.543674 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.572360 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f6421cfa-3c32-4c2f-89c5-76e5480a35c3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:31.573629 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f6421cfa-3c32-4c2f-89c5-76e5480a35c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:31.583255 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1384/2785] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:47:31.587337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:31.589920 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1402/2786] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:31.594121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6421cfa-3c32-4c2f-89c5-76e5480a35c3 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:31.599773 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383d54-f1a3-46e2-a94b-2b1b7b5dd89d admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.604776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6421cfa-3c32-4c2f-89c5-76e5480a35c3 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.605459 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f975e8-5602-4cd1-b9a8-4e4561f9630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.606389 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f975e8-5602-4cd1-b9a8-4e4561f9630a admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.606836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f975e8-5602-4cd1-b9a8-4e4561f9630a admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.607185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f975e8-5602-4cd1-b9a8-4e4561f9630a admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.607965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f975e8-5602-4cd1-b9a8-4e4561f9630a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.609998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f975e8-5602-4cd1-b9a8-4e4561f9630a admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.610893 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.612094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.612535 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.613004 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.613890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:47:31.614375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.616717 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.629555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1403/2787] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:47:31.634631 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:31.647652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d38ae-3367-4c1f-8f60-e7b029b4162c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.651223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783fd4-a40c-4e24-b637-5041e74d5624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.652309 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783fd4-a40c-4e24-b637-5041e74d5624 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.652674 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783fd4-a40c-4e24-b637-5041e74d5624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.653208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783fd4-a40c-4e24-b637-5041e74d5624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.654100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783fd4-a40c-4e24-b637-5041e74d5624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.656476 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783fd4-a40c-4e24-b637-5041e74d5624 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.724586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1385/2788] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:31 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:31.728696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f975e8-5602-4cd1-b9a8-4e4561f9630a admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:31.743734 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1404/2789] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:31 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:31.747814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783fd4-a40c-4e24-b637-5041e74d5624 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:31.837178 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f975e8-5602-4cd1-b9a8-4e4561f9630a admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.860042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783fd4-a40c-4e24-b637-5041e74d5624 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.869319 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2dc15-fbfe-4744-b4db-bcfc5b872e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.870817 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2dc15-fbfe-4744-b4db-bcfc5b872e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.881778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2dc15-fbfe-4744-b4db-bcfc5b872e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.881778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2dc15-fbfe-4744-b4db-bcfc5b872e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.881778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2dc15-fbfe-4744-b4db-bcfc5b872e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.881778 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2dc15-fbfe-4744-b4db-bcfc5b872e5c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.923313 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9c2ae-88a7-40c0-b581-41a2f36d658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.924148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c2ae-88a7-40c0-b581-41a2f36d658b admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.927909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c2ae-88a7-40c0-b581-41a2f36d658b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.927909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9c2ae-88a7-40c0-b581-41a2f36d658b admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.927909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9c2ae-88a7-40c0-b581-41a2f36d658b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.927909 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9c2ae-88a7-40c0-b581-41a2f36d658b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.952207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1405/2790] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:31 2022] POST /identity/v3/users => generated 281 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:31.956370 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2dc15-fbfe-4744-b4db-bcfc5b872e5c admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:31.967416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2dc15-fbfe-4744-b4db-bcfc5b872e5c admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:31.972131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaaee5-f2ff-4dc8-a9e3-e1faba93a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:31.972831 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaaee5-f2ff-4dc8-a9e3-e1faba93a526 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:31.973118 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaaee5-f2ff-4dc8-a9e3-e1faba93a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:31.973414 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaaee5-f2ff-4dc8-a9e3-e1faba93a526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:31.974151 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaaee5-f2ff-4dc8-a9e3-e1faba93a526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:31.976095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaaee5-f2ff-4dc8-a9e3-e1faba93a526 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:31.989277 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1406/2791] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:31.994098 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaaee5-f2ff-4dc8-a9e3-e1faba93a526 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.022862 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1386/2792] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:31 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:32.027478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaaee5-f2ff-4dc8-a9e3-e1faba93a526 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:32.028833 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9c2ae-88a7-40c0-b581-41a2f36d658b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.033599 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0118dab-e4f4-4e06-80ae-e50bf0477144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:32.034457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0118dab-e4f4-4e06-80ae-e50bf0477144 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.034652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0118dab-e4f4-4e06-80ae-e50bf0477144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.035107 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0118dab-e4f4-4e06-80ae-e50bf0477144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.036179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0118dab-e4f4-4e06-80ae-e50bf0477144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:32.042200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0118dab-e4f4-4e06-80ae-e50bf0477144 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:32.044928 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9c2ae-88a7-40c0-b581-41a2f36d658b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:32.050467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cfa9d-f13d-48f5-b28d-e712af242f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:32.051117 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cfa9d-f13d-48f5-b28d-e712af242f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.051418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cfa9d-f13d-48f5-b28d-e712af242f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.051680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cfa9d-f13d-48f5-b28d-e712af242f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.053371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cfa9d-f13d-48f5-b28d-e712af242f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:32.055128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cfa9d-f13d-48f5-b28d-e712af242f06 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:32.062131 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1407/2793] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:32.063421 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0118dab-e4f4-4e06-80ae-e50bf0477144 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.074585 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1387/2794] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:32.074806 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0118dab-e4f4-4e06-80ae-e50bf0477144 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:32.078831 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cfa9d-f13d-48f5-b28d-e712af242f06 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.081273 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f78dc2-86e4-43d8-94b2-12abd7106c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:32.082167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f78dc2-86e4-43d8-94b2-12abd7106c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.082452 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f78dc2-86e4-43d8-94b2-12abd7106c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.082799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f78dc2-86e4-43d8-94b2-12abd7106c8a admin admin] PATH_INFO: `/v3/projects/520616bb9def4e818a2a9b35f2c8a1a6/users/854fcf3964934e44b9ee6fb48b169e4a/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.091907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cfa9d-f13d-48f5-b28d-e712af242f06 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:32.097954 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec121-ea49-4eaa-ac2a-12df6809002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:32.099307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec121-ea49-4eaa-ac2a-12df6809002b admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.099307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec121-ea49-4eaa-ac2a-12df6809002b admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.099307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec121-ea49-4eaa-ac2a-12df6809002b admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.100019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ec121-ea49-4eaa-ac2a-12df6809002b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:32.100677 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f78dc2-86e4-43d8-94b2-12abd7106c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=520616bb9def4e818a2a9b35f2c8a1a6, user_id=854fcf3964934e44b9ee6fb48b169e4a, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:32.102076 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ec121-ea49-4eaa-ac2a-12df6809002b admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:32.106220 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f78dc2-86e4-43d8-94b2-12abd7106c8a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:32.114461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1388/2795] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:32.119540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec121-ea49-4eaa-ac2a-12df6809002b admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.130181 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec121-ea49-4eaa-ac2a-12df6809002b admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:32.138837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d0e96-101b-4a62-9411-32d38e73da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:32.143200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d0e96-101b-4a62-9411-32d38e73da05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.143200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d0e96-101b-4a62-9411-32d38e73da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.143200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d0e96-101b-4a62-9411-32d38e73da05 admin admin] PATH_INFO: `/v3/projects/dc77f029f09c4b3c8d71c7e5ee98cf0d/users/581514c13192448cad1339527edf0610/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.159027 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d0e96-101b-4a62-9411-32d38e73da05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc77f029f09c4b3c8d71c7e5ee98cf0d, user_id=581514c13192448cad1339527edf0610, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:32.162985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d0e96-101b-4a62-9411-32d38e73da05 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:32.243914 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1408/2796] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:32 2022] PUT /identity/v3/projects/520616bb9def4e818a2a9b35f2c8a1a6/users/854fcf3964934e44b9ee6fb48b169e4a/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:32.255576 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d09a9-9e89-4ed3-9694-872c7b50bb02 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.255864 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d09a9-9e89-4ed3-9694-872c7b50bb02 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.256143 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d09a9-9e89-4ed3-9694-872c7b50bb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.273517 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1389/2797] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:32 2022] PUT /identity/v3/projects/dc77f029f09c4b3c8d71c7e5ee98cf0d/users/581514c13192448cad1339527edf0610/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:32.284867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a50123-8f4b-4085-9722-9658a6b7e14a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.285170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a50123-8f4b-4085-9722-9658a6b7e14a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.285458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a50123-8f4b-4085-9722-9658a6b7e14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.300037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-004d09a9-9e89-4ed3-9694-872c7b50bb02 None None] MFA Rules not processed for user `854fcf3964934e44b9ee6fb48b169e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:32.304000 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-004d09a9-9e89-4ed3-9694-872c7b50bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:32.313344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-08a50123-8f4b-4085-9722-9658a6b7e14a None None] MFA Rules not processed for user `581514c13192448cad1339527edf0610`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:32.314698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-08a50123-8f4b-4085-9722-9658a6b7e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:32.372189 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1409/2798] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:32.382837 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1390/2799] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:32.393581 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d09a9-9e89-4ed3-9694-872c7b50bb02 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.395139 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-004d09a9-9e89-4ed3-9694-872c7b50bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:32.409630 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a50123-8f4b-4085-9722-9658a6b7e14a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.411163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-08a50123-8f4b-4085-9722-9658a6b7e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:32.452977 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d09a9-9e89-4ed3-9694-872c7b50bb02 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:32.456775 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220eba-cd51-4f1f-b81f-b9b6452023ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f2a360a89548208edd5fdff1a04e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:32.457642 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220eba-cd51-4f1f-b81f-b9b6452023ec service glance] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.457950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220eba-cd51-4f1f-b81f-b9b6452023ec service glance] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.458219 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b220eba-cd51-4f1f-b81f-b9b6452023ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.467808 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220eba-cd51-4f1f-b81f-b9b6452023ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:32.468352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a50123-8f4b-4085-9722-9658a6b7e14a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:32.469267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b220eba-cd51-4f1f-b81f-b9b6452023ec service glance] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:32.472350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6acb69-7d6e-4da9-abda-e2af4b9e1a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:32.473137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6acb69-7d6e-4da9-abda-e2af4b9e1a1a service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.473489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6acb69-7d6e-4da9-abda-e2af4b9e1a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.473838 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6acb69-7d6e-4da9-abda-e2af4b9e1a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.478493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1410/2800] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:32.482709 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6acb69-7d6e-4da9-abda-e2af4b9e1a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:32.486318 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6acb69-7d6e-4da9-abda-e2af4b9e1a1a service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:32.493769 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1391/2801] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:47:32.509089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220eba-cd51-4f1f-b81f-b9b6452023ec service glance] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.570696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b220eba-cd51-4f1f-b81f-b9b6452023ec service glance] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:32.575709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:32.576575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.576862 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.577172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] PATH_INFO: `/v3/users/854fcf3964934e44b9ee6fb48b169e4a` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.578377 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] RBAC: Authorizing `identity:delete_user(user_id=854fcf3964934e44b9ee6fb48b169e4a)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:32.580314 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:32.771078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854fcf3964934e44b9ee6fb48b169e4a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:32.778230 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854fcf3964934e44b9ee6fb48b169e4a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:32.784181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854fcf3964934e44b9ee6fb48b169e4a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:32.784181 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854fcf3964934e44b9ee6fb48b169e4a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:32.843303 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854fcf3964934e44b9ee6fb48b169e4a'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:32.861718 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1411/2802] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:32 2022] DELETE /identity/v3/users/854fcf3964934e44b9ee6fb48b169e4a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:32.867006 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7a7f0-3e5b-4d8b-a4bc-e9a688dfcc8a None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:32.867300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7a7f0-3e5b-4d8b-a4bc-e9a688dfcc8a None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:32.867580 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7a7f0-3e5b-4d8b-a4bc-e9a688dfcc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:32.886001 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-8cb7a7f0-3e5b-4d8b-a4bc-e9a688dfcc8a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:32.887216 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8cb7a7f0-3e5b-4d8b-a4bc-e9a688dfcc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:32.947319 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1392/2803] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:32.957310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:32.958762 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:33.020401 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c45963-59e4-4a8f-aa6e-5f3522c0124e admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:33.024719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ab79-4bd4-45e1-8f27-b5555e2c0854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:33.025393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ab79-4bd4-45e1-8f27-b5555e2c0854 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:33.025682 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ab79-4bd4-45e1-8f27-b5555e2c0854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:33.025968 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ab79-4bd4-45e1-8f27-b5555e2c0854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:33.037084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0ab79-4bd4-45e1-8f27-b5555e2c0854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:33.038908 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0ab79-4bd4-45e1-8f27-b5555e2c0854 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:33.052141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1412/2804] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:33.496022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7a7f0-3e5b-4d8b-a4bc-e9a688dfcc8a None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:33.497529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8cb7a7f0-3e5b-4d8b-a4bc-e9a688dfcc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:33.510346 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7a7f0-3e5b-4d8b-a4bc-e9a688dfcc8a None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:33.515039 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:33.519938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:33.519938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:33.519938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] PATH_INFO: `/v3/projects/520616bb9def4e818a2a9b35f2c8a1a6` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:33.519938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520616bb9def4e818a2a9b35f2c8a1a6)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:33.519938 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:33.659963 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520616bb9def4e818a2a9b35f2c8a1a6', 'request_id': 'req-8530848e-2e78-40d8-bde9-8b329b25f296'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:33.745365 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520616bb9def4e818a2a9b35f2c8a1a6', 'request_id': 'req-8530848e-2e78-40d8-bde9-8b329b25f296'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:33.751416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520616bb9def4e818a2a9b35f2c8a1a6', 'request_id': 'req-8530848e-2e78-40d8-bde9-8b329b25f296'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:33.763172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] The token cache is being invalidate because project 520616bb9def4e818a2a9b35f2c8a1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:33.763472 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:33.764208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8530848e-2e78-40d8-bde9-8b329b25f296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:33.766146 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1393/2805] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:33 2022] DELETE /identity/v3/projects/520616bb9def4e818a2a9b35f2c8a1a6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:33.771043 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce0c21-36f2-4fb9-ba41-6c117829842c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:33.771462 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce0c21-36f2-4fb9-ba41-6c117829842c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:33.771802 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce0c21-36f2-4fb9-ba41-6c117829842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:33.793984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-a0ce0c21-36f2-4fb9-ba41-6c117829842c None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:33.795341 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-a0ce0c21-36f2-4fb9-ba41-6c117829842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:33.869183 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1413/2806] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:33.876836 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91222-9726-4a99-8e97-dd64dd57d696 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:33.877133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91222-9726-4a99-8e97-dd64dd57d696 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:33.877420 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91222-9726-4a99-8e97-dd64dd57d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:33.899032 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-1ad91222-9726-4a99-8e97-dd64dd57d696 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:33.900274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-1ad91222-9726-4a99-8e97-dd64dd57d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:33.909199 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1394/2807] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:33.914251 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce0c21-36f2-4fb9-ba41-6c117829842c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:33.924121 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce0c21-36f2-4fb9-ba41-6c117829842c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:33.929709 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:33.930498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:33.930884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:33.931255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:33.932133 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:47:33.932575 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:33.934218 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:33.947020 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1414/2808] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:47:33.951094 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91222-9726-4a99-8e97-dd64dd57d696 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:33.960965 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91222-9726-4a99-8e97-dd64dd57d696 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:33.966048 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc8388-77bf-4284-8261-a7cb52bd221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:33.966821 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc8388-77bf-4284-8261-a7cb52bd221c admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:33.967127 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc8388-77bf-4284-8261-a7cb52bd221c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:33.967424 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc8388-77bf-4284-8261-a7cb52bd221c admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:33.968118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc8388-77bf-4284-8261-a7cb52bd221c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:33.970123 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc8388-77bf-4284-8261-a7cb52bd221c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:34.053025 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1395/2809] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:33 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:34.058154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:34.068653 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96164d86-a73b-4659-a9cb-6e2b713c4a74 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:34.126493 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a98cb-a286-4e9d-82c6-43f02434a558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:34.127192 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a98cb-a286-4e9d-82c6-43f02434a558 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:34.127478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a98cb-a286-4e9d-82c6-43f02434a558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:34.127754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a98cb-a286-4e9d-82c6-43f02434a558 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:34.128483 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a98cb-a286-4e9d-82c6-43f02434a558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:34.130596 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a98cb-a286-4e9d-82c6-43f02434a558 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:34.192253 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1415/2810] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:34 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:47:34.196324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc8388-77bf-4284-8261-a7cb52bd221c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:34.207377 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc8388-77bf-4284-8261-a7cb52bd221c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:34.212110 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af48e5-01b3-4037-b0fe-27cf9a6c7cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:34.212811 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af48e5-01b3-4037-b0fe-27cf9a6c7cac admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:34.213100 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af48e5-01b3-4037-b0fe-27cf9a6c7cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:34.213383 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af48e5-01b3-4037-b0fe-27cf9a6c7cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:34.214119 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af48e5-01b3-4037-b0fe-27cf9a6c7cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:34.215766 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af48e5-01b3-4037-b0fe-27cf9a6c7cac admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:34.226851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1396/2811] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:34.230892 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a98cb-a286-4e9d-82c6-43f02434a558 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:34.242040 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a98cb-a286-4e9d-82c6-43f02434a558 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:34.246742 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f0072-893e-4f71-b47b-8fba9329716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:34.247404 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0072-893e-4f71-b47b-8fba9329716a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:34.247689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0072-893e-4f71-b47b-8fba9329716a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:34.247988 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0072-893e-4f71-b47b-8fba9329716a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:34.248845 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f0072-893e-4f71-b47b-8fba9329716a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:34.250323 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f0072-893e-4f71-b47b-8fba9329716a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:34.260790 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1416/2812] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:34.265371 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af48e5-01b3-4037-b0fe-27cf9a6c7cac admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:34.278083 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af48e5-01b3-4037-b0fe-27cf9a6c7cac admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:34.283020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:34.283970 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:34.284254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:34.284531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] PATH_INFO: `/v3/projects/612c0085f1b940c3a7805fe9a90cdbc3/users/956c1a349c9a4bae9d820a32a4ef311e/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:34.300604 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612c0085f1b940c3a7805fe9a90cdbc3, user_id=956c1a349c9a4bae9d820a32a4ef311e, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:34.303030 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:34.391490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1397/2813] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:34 2022] PUT /identity/v3/projects/612c0085f1b940c3a7805fe9a90cdbc3/users/956c1a349c9a4bae9d820a32a4ef311e/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:34.398318 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554abe35-5acf-4940-9fad-e65531b332a2 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:34.398636 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554abe35-5acf-4940-9fad-e65531b332a2 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:34.398922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554abe35-5acf-4940-9fad-e65531b332a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:34.419101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-554abe35-5acf-4940-9fad-e65531b332a2 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:34.420327 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-554abe35-5acf-4940-9fad-e65531b332a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:34.478707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1417/2814] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:34.488337 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:34.490144 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:34.546981 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6369b-790d-460d-98eb-24f8a289b512 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:34.550914 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:34.551577 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:34.551901 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:34.552184 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:34.562019 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:34.563530 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:34.573004 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1398/2815] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:35.786708 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ffa5-3c75-4602-b346-4926f6f5ca6c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:35.787173 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ffa5-3c75-4602-b346-4926f6f5ca6c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:35.788029 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ffa5-3c75-4602-b346-4926f6f5ca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:35.816511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-4fc9ffa5-3c75-4602-b346-4926f6f5ca6c None None] MFA Rules not processed for user `956c1a349c9a4bae9d820a32a4ef311e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:35.817744 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-4fc9ffa5-3c75-4602-b346-4926f6f5ca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:35.888649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1418/2816] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:35.902033 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:35.903590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:35.962571 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1c7b8-b701-42e2-847a-9cbc8e9d1650 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:35.967203 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90351258-7e7f-40d5-b527-d27cf9e9e475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:35.968436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351258-7e7f-40d5-b527-d27cf9e9e475 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:35.968992 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351258-7e7f-40d5-b527-d27cf9e9e475 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:35.969509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351258-7e7f-40d5-b527-d27cf9e9e475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:35.979677 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90351258-7e7f-40d5-b527-d27cf9e9e475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:35.981125 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90351258-7e7f-40d5-b527-d27cf9e9e475 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:35.990560 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1399/2817] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:47:37.602357 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9db65-4bd7-4aea-be9d-6b34e2d34f5f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:37.602990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9db65-4bd7-4aea-be9d-6b34e2d34f5f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:37.602990 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9db65-4bd7-4aea-be9d-6b34e2d34f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:37.620441 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-02e9db65-4bd7-4aea-be9d-6b34e2d34f5f None None] MFA Rules not processed for user `956c1a349c9a4bae9d820a32a4ef311e`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:37.621714 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-02e9db65-4bd7-4aea-be9d-6b34e2d34f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:37.628995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1419/2818] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:44.735969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90351258-7e7f-40d5-b527-d27cf9e9e475 service cinder] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:44.745628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90351258-7e7f-40d5-b527-d27cf9e9e475 service cinder] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:44.749328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:44.750086 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:44.750375 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:44.750680 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:44.752428 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:44.812982 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:44.814430 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:44.823955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1400/2819] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:54.384092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af3b29-3616-43cf-b1ff-409ce7e908b5 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:54.384619 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af3b29-3616-43cf-b1ff-409ce7e908b5 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:54.384740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af3b29-3616-43cf-b1ff-409ce7e908b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:54.402498 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d2af3b29-3616-43cf-b1ff-409ce7e908b5 None None] MFA Rules not processed for user `e3cb95e59e354cf3b55407b8873fad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:54.403707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d2af3b29-3616-43cf-b1ff-409ce7e908b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:54.455835 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1420/2820] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:57.034283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:57.035948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:57.053024 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071d1a-231f-4b82-85a5-64f4ec76e4e4 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:57.055300 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:57.056174 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:57.056458 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:57.056734 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] PATH_INFO: `/v3/users/581514c13192448cad1339527edf0610` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:57.058631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581514c13192448cad1339527edf0610)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:57.060556 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:57.284621 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581514c13192448cad1339527edf0610'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:57.285307 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581514c13192448cad1339527edf0610'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:57.292130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581514c13192448cad1339527edf0610'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:57.292768 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581514c13192448cad1339527edf0610'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:57.333275 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581514c13192448cad1339527edf0610'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:57.354133 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1401/2821] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:47:57 2022] DELETE /identity/v3/users/581514c13192448cad1339527edf0610 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:57.358771 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8852ea-40e5-490a-82e0-24539de3de4a None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:57.359284 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8852ea-40e5-490a-82e0-24539de3de4a None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:57.359475 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8852ea-40e5-490a-82e0-24539de3de4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:57.378077 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-cc8852ea-40e5-490a-82e0-24539de3de4a None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:57.380652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cc8852ea-40e5-490a-82e0-24539de3de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:57.438116 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1421/2822] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:57.448590 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:57.450106 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:57.505282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a824d4-dde6-4e86-8151-2be1ade76eb7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:57.509202 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9351db-d04f-4299-96ef-68d19110e844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:57.509884 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9351db-d04f-4299-96ef-68d19110e844 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:57.510808 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9351db-d04f-4299-96ef-68d19110e844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:57.511091 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9351db-d04f-4299-96ef-68d19110e844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:57.520277 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9351db-d04f-4299-96ef-68d19110e844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:57.521741 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9351db-d04f-4299-96ef-68d19110e844 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:57.531498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1402/2823] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:47:57.894991 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8852ea-40e5-490a-82e0-24539de3de4a None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:57.896948 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-cc8852ea-40e5-490a-82e0-24539de3de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:57.924546 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8852ea-40e5-490a-82e0-24539de3de4a None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:57.930165 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:57.931072 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:57.931390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:57.931666 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] PATH_INFO: `/v3/projects/dc77f029f09c4b3c8d71c7e5ee98cf0d` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:57.933511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc77f029f09c4b3c8d71c7e5ee98cf0d)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:57.936130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:58.019354 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc77f029f09c4b3c8d71c7e5ee98cf0d', 'request_id': 'req-b5df9221-b850-4064-ab7f-0afe5f1d096c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:58.168285 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc77f029f09c4b3c8d71c7e5ee98cf0d', 'request_id': 'req-b5df9221-b850-4064-ab7f-0afe5f1d096c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:58.175368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc77f029f09c4b3c8d71c7e5ee98cf0d', 'request_id': 'req-b5df9221-b850-4064-ab7f-0afe5f1d096c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:58.188566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] The token cache is being invalidate because project dc77f029f09c4b3c8d71c7e5ee98cf0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:47:58.188952 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:58.189821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-b5df9221-b850-4064-ab7f-0afe5f1d096c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:47:58.194368 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1422/2824] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:47:57 2022] DELETE /identity/v3/projects/dc77f029f09c4b3c8d71c7e5ee98cf0d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:47:58.199888 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49836d9-95ce-48d1-9abc-1e815796e2f9 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.201235 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49836d9-95ce-48d1-9abc-1e815796e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.201835 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49836d9-95ce-48d1-9abc-1e815796e2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.222240 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-b49836d9-95ce-48d1-9abc-1e815796e2f9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:58.223662 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-b49836d9-95ce-48d1-9abc-1e815796e2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:58.292648 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1403/2825] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:58.300776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca8a0-ba71-4550-b20e-f6f1b5f479a3 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.311939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca8a0-ba71-4550-b20e-f6f1b5f479a3 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.311939 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ca8a0-ba71-4550-b20e-f6f1b5f479a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.320548 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f56ca8a0-ba71-4550-b20e-f6f1b5f479a3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:58.321984 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f56ca8a0-ba71-4550-b20e-f6f1b5f479a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:58.333342 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1423/2826] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:47:58.337634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49836d9-95ce-48d1-9abc-1e815796e2f9 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:58.348612 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49836d9-95ce-48d1-9abc-1e815796e2f9 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:58.359200 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:58.360160 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.360628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.360904 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.361653 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80048) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:47:58.361964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:58.363599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:58.376508 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1404/2827] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:47:58.381290 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca8a0-ba71-4550-b20e-f6f1b5f479a3 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:58.391556 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ca8a0-ba71-4550-b20e-f6f1b5f479a3 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:58.397179 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cb60b-dfd8-4549-87b8-f21263dc479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:58.397828 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb60b-dfd8-4549-87b8-f21263dc479f admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.398114 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb60b-dfd8-4549-87b8-f21263dc479f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.398390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb60b-dfd8-4549-87b8-f21263dc479f admin admin] PATH_INFO: `/v3/projects` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.399170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cb60b-dfd8-4549-87b8-f21263dc479f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:58.401757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cb60b-dfd8-4549-87b8-f21263dc479f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:58.502858 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:58.503071 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1424/2828] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:47:58 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:58.515566 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7dc9-e95a-4213-8f07-29e2958fb2d4 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:58.574288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d3941-76aa-463a-8ada-691748c49710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:58.575016 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d3941-76aa-463a-8ada-691748c49710 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.575303 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d3941-76aa-463a-8ada-691748c49710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.575586 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d3941-76aa-463a-8ada-691748c49710 admin admin] PATH_INFO: `/v3/users` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.576289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d3941-76aa-463a-8ada-691748c49710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:58.578289 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d3941-76aa-463a-8ada-691748c49710 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:58.657524 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1405/2829] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:47:58 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:47:58.658868 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cb60b-dfd8-4549-87b8-f21263dc479f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:58.671776 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cb60b-dfd8-4549-87b8-f21263dc479f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:58.676566 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fef8a0-a066-4db3-a4d8-9300c4b4a991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:58.678402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef8a0-a066-4db3-a4d8-9300c4b4a991 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.678402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef8a0-a066-4db3-a4d8-9300c4b4a991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.678402 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fef8a0-a066-4db3-a4d8-9300c4b4a991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.678729 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fef8a0-a066-4db3-a4d8-9300c4b4a991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:58.680101 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fef8a0-a066-4db3-a4d8-9300c4b4a991 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:58.691177 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1425/2830] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:58.695503 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d3941-76aa-463a-8ada-691748c49710 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:58.705955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d3941-76aa-463a-8ada-691748c49710 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:58.710893 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50366f5-149f-415c-b88a-63bab838ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:58.711555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50366f5-149f-415c-b88a-63bab838ed52 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.711842 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50366f5-149f-415c-b88a-63bab838ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.712150 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50366f5-149f-415c-b88a-63bab838ed52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.712908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50366f5-149f-415c-b88a-63bab838ed52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:58.714724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50366f5-149f-415c-b88a-63bab838ed52 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:58.727724 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1406/2831] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:47:58.729239 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fef8a0-a066-4db3-a4d8-9300c4b4a991 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:58.739644 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fef8a0-a066-4db3-a4d8-9300c4b4a991 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:58.745120 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:58.746012 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.746305 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.747036 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] PATH_INFO: `/v3/projects/01714d55ef014d06b04dcb5de7be84d3/users/cd5b136cea58420ca8d5624408052f6e/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.763045 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01714d55ef014d06b04dcb5de7be84d3, user_id=cd5b136cea58420ca8d5624408052f6e, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:58.765719 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:58.831170 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1426/2832] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:47:58 2022] PUT /identity/v3/projects/01714d55ef014d06b04dcb5de7be84d3/users/cd5b136cea58420ca8d5624408052f6e/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:47:58.897461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4f4e-3948-4859-9318-ba74dcf9a8ad None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:58.897948 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4f4e-3948-4859-9318-ba74dcf9a8ad None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:58.898324 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4f4e-3948-4859-9318-ba74dcf9a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:58.926423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-516e4f4e-3948-4859-9318-ba74dcf9a8ad None None] MFA Rules not processed for user `cd5b136cea58420ca8d5624408052f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:47:58.927760 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-516e4f4e-3948-4859-9318-ba74dcf9a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:58.995652 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1407/2833] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:47:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:47:59.006916 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:47:59.008658 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:47:59.066950 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487bea-3fe4-49d9-9f19-a99acfe1d858 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:47:59.074135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1f28a-1e54-4018-b08c-fdddb22e9219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:47:59.074135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f28a-1e54-4018-b08c-fdddb22e9219 service cinder] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:47:59.074135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f28a-1e54-4018-b08c-fdddb22e9219 service cinder] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:47:59.074135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1f28a-1e54-4018-b08c-fdddb22e9219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:47:59.080987 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1f28a-1e54-4018-b08c-fdddb22e9219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:47:59.085453 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1f28a-1e54-4018-b08c-fdddb22e9219 service cinder] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:47:59.095328 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1427/2834] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:47:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:48:06.552719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14c9f-56c8-4958-9e20-0e07ca8c122f None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:06.553299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14c9f-56c8-4958-9e20-0e07ca8c122f None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:06.553299 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb14c9f-56c8-4958-9e20-0e07ca8c122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:06.572165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-acb14c9f-56c8-4958-9e20-0e07ca8c122f None None] MFA Rules not processed for user `956c1a349c9a4bae9d820a32a4ef311e`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:48:06.573436 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-acb14c9f-56c8-4958-9e20-0e07ca8c122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:06.632282 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1408/2835] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:48:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:48:22.497699 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1f28a-1e54-4018-b08c-fdddb22e9219 service cinder] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:22.559610 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1f28a-1e54-4018-b08c-fdddb22e9219 service cinder] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:22.564274 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:22.565152 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:22.565450 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:22.565731 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] PATH_INFO: `/v3/users/cd5b136cea58420ca8d5624408052f6e` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:22.566975 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5b136cea58420ca8d5624408052f6e)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:22.568910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:22.752261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5b136cea58420ca8d5624408052f6e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:22.762392 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5b136cea58420ca8d5624408052f6e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:22.763457 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5b136cea58420ca8d5624408052f6e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:22.764387 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5b136cea58420ca8d5624408052f6e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:22.858490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5b136cea58420ca8d5624408052f6e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:22.877607 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1428/2836] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:48:22 2022] DELETE /identity/v3/users/cd5b136cea58420ca8d5624408052f6e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:48:22.882232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2b6b-b6a0-4c76-ba5b-9fd6e7b24365 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:22.882743 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2b6b-b6a0-4c76-ba5b-9fd6e7b24365 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:22.882851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2b6b-b6a0-4c76-ba5b-9fd6e7b24365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:22.900043 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-d40c2b6b-b6a0-4c76-ba5b-9fd6e7b24365 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:48:22.901491 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d40c2b6b-b6a0-4c76-ba5b-9fd6e7b24365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:22.957208 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1409/2837] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:48:22.967062 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:22.968492 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:23.024618 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626b474-df93-4ed5-8929-ce8b474f0c23 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:23.028479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37e93c-7080-495d-9be1-d26eb2397344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:23.029122 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e93c-7080-495d-9be1-d26eb2397344 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:23.029406 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e93c-7080-495d-9be1-d26eb2397344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:23.030712 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e93c-7080-495d-9be1-d26eb2397344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:23.039142 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37e93c-7080-495d-9be1-d26eb2397344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:23.040733 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37e93c-7080-495d-9be1-d26eb2397344 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:23.051526 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1429/2838] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:48:23.422140 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c2b6b-b6a0-4c76-ba5b-9fd6e7b24365 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:23.424668 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d40c2b6b-b6a0-4c76-ba5b-9fd6e7b24365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:23.437010 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c2b6b-b6a0-4c76-ba5b-9fd6e7b24365 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:23.441905 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:23.442939 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:23.443228 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:23.443505 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] PATH_INFO: `/v3/projects/01714d55ef014d06b04dcb5de7be84d3` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:23.445051 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01714d55ef014d06b04dcb5de7be84d3)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:23.446794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:23.549165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01714d55ef014d06b04dcb5de7be84d3', 'request_id': 'req-d28895db-fa62-4c03-8126-b48bfc67ac2c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:23.601393 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01714d55ef014d06b04dcb5de7be84d3', 'request_id': 'req-d28895db-fa62-4c03-8126-b48bfc67ac2c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:23.607234 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01714d55ef014d06b04dcb5de7be84d3', 'request_id': 'req-d28895db-fa62-4c03-8126-b48bfc67ac2c'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:23.618069 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] The token cache is being invalidate because project 01714d55ef014d06b04dcb5de7be84d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:48:23.618352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:23.619068 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:23.620642 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1410/2839] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:48:23 2022] DELETE /identity/v3/projects/01714d55ef014d06b04dcb5de7be84d3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:48:35.943922 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d112dc-1bf2-4ddc-a154-96e7ea552aac None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:35.944433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d112dc-1bf2-4ddc-a154-96e7ea552aac None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:35.944536 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d112dc-1bf2-4ddc-a154-96e7ea552aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:35.963861 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-e8d112dc-1bf2-4ddc-a154-96e7ea552aac None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:48:35.965094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-e8d112dc-1bf2-4ddc-a154-96e7ea552aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:36.019027 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1430/2840] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Apr 28 16:48:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:48:36.130815 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:36.132220 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:36.213722 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28895db-fa62-4c03-8126-b48bfc67ac2c admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:36.218706 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507cca7-4139-4a0f-a4a9-edbc92d64321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:36.219350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507cca7-4139-4a0f-a4a9-edbc92d64321 service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:36.219631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507cca7-4139-4a0f-a4a9-edbc92d64321 service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:36.219907 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507cca7-4139-4a0f-a4a9-edbc92d64321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:36.227723 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507cca7-4139-4a0f-a4a9-edbc92d64321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:36.229306 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507cca7-4139-4a0f-a4a9-edbc92d64321 service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:36.237645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1411/2841] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:48:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 28 16:48:52.737176 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ccb61-1e1a-49d3-afae-8510c044922c None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:52.737650 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ccb61-1e1a-49d3-afae-8510c044922c None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:52.737745 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ccb61-1e1a-49d3-afae-8510c044922c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:52.756013 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-819ccb61-1e1a-49d3-afae-8510c044922c None None] MFA Rules not processed for user `86cf6adf3f29481793c254c056ddcadd`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:48:52.757247 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-819ccb61-1e1a-49d3-afae-8510c044922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:52.765196 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1431/2842] 10.222.0.43 () {58 vars in 967 bytes} [Thu Apr 28 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:48:52.777628 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507cca7-4139-4a0f-a4a9-edbc92d64321 service swift] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:52.788283 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507cca7-4139-4a0f-a4a9-edbc92d64321 service swift] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:52.793406 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63272e-66e2-41db-87fe-31374b7ba79c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f397f35533540c6b92f0f4fe220d565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:52.794170 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63272e-66e2-41db-87fe-31374b7ba79c service swift] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:52.803177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63272e-66e2-41db-87fe-31374b7ba79c service swift] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:52.803177 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63272e-66e2-41db-87fe-31374b7ba79c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:52.803767 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63272e-66e2-41db-87fe-31374b7ba79c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:52.805352 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63272e-66e2-41db-87fe-31374b7ba79c service swift] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:52.814452 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1412/2843] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Apr 28 16:48:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 28 16:48:55.646696 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ccb61-1e1a-49d3-afae-8510c044922c None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:55.648226 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-819ccb61-1e1a-49d3-afae-8510c044922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:55.714135 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ccb61-1e1a-49d3-afae-8510c044922c None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:55.718843 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:55.719757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:55.720042 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:55.720321 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] PATH_INFO: `/v3/users/956c1a349c9a4bae9d820a32a4ef311e` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:55.721551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] RBAC: Authorizing `identity:delete_user(user_id=956c1a349c9a4bae9d820a32a4ef311e)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:55.723522 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:55.893811 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956c1a349c9a4bae9d820a32a4ef311e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:55.900863 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956c1a349c9a4bae9d820a32a4ef311e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:55.901549 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956c1a349c9a4bae9d820a32a4ef311e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:55.905756 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956c1a349c9a4bae9d820a32a4ef311e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:55.943154 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-bca479f7-3367-46ea-8d89-f0581e25157d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956c1a349c9a4bae9d820a32a4ef311e'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:55.959937 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1432/2844] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:48:55 2022] DELETE /identity/v3/users/956c1a349c9a4bae9d820a32a4ef311e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:48:56.196754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63272e-66e2-41db-87fe-31374b7ba79c service swift] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:56.207978 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63272e-66e2-41db-87fe-31374b7ba79c service swift] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:56.261988 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:56.262877 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.263163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.263441 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] PATH_INFO: `/v3/projects/612c0085f1b940c3a7805fe9a90cdbc3` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.265173 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=612c0085f1b940c3a7805fe9a90cdbc3)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:56.267149 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:56.366215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612c0085f1b940c3a7805fe9a90cdbc3', 'request_id': 'req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:56.423290 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612c0085f1b940c3a7805fe9a90cdbc3', 'request_id': 'req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:56.428969 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612c0085f1b940c3a7805fe9a90cdbc3', 'request_id': 'req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:56.440304 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] The token cache is being invalidate because project 612c0085f1b940c3a7805fe9a90cdbc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:48:56.440531 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:56.441222 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-d685f35f-6172-48ac-94c5-a2d0f1f06d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:48:56.442794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1413/2845] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:48:56 2022] DELETE /identity/v3/projects/612c0085f1b940c3a7805fe9a90cdbc3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:48:56.447703 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0c21-9420-4aae-b6d1-9e2d6d48d1f0 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.447993 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0c21-9420-4aae-b6d1-9e2d6d48d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.448267 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0c21-9420-4aae-b6d1-9e2d6d48d1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.466663 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-d3fc0c21-9420-4aae-b6d1-9e2d6d48d1f0 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:48:56.467860 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d3fc0c21-9420-4aae-b6d1-9e2d6d48d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:56.524210 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1433/2846] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:48:56.532423 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d58359-83fc-48ae-922b-d4e92fe91ad3 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.532710 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d58359-83fc-48ae-922b-d4e92fe91ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.533031 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d58359-83fc-48ae-922b-d4e92fe91ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.550794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-c3d58359-83fc-48ae-922b-d4e92fe91ad3 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:48:56.552003 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c3d58359-83fc-48ae-922b-d4e92fe91ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:56.559972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1414/2847] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:48:56.565884 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0c21-9420-4aae-b6d1-9e2d6d48d1f0 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:56.575353 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0c21-9420-4aae-b6d1-9e2d6d48d1f0 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:56.580480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:56.581130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.581413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.581689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.582487 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:48:56.582820 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:56.585638 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:56.603444 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1434/2848] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 28 16:48:56.607805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d58359-83fc-48ae-922b-d4e92fe91ad3 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:56.616890 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d58359-83fc-48ae-922b-d4e92fe91ad3 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:56.621704 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac620f-3892-4b94-9682-d466b2d02e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:56.622382 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac620f-3892-4b94-9682-d466b2d02e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.622713 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac620f-3892-4b94-9682-d466b2d02e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.622993 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac620f-3892-4b94-9682-d466b2d02e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.623681 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac620f-3892-4b94-9682-d466b2d02e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:56.626092 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac620f-3892-4b94-9682-d466b2d02e12 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:56.705113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1415/2849] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:48:56 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:48:56.709150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:56.719380 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14c8b-fa7a-48a4-9348-135236ade948 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:56.772613 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b306-d609-4571-89f4-3d7559d8effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:56.773270 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b306-d609-4571-89f4-3d7559d8effe admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.773555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b306-d609-4571-89f4-3d7559d8effe admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.773833 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b306-d609-4571-89f4-3d7559d8effe admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.774512 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6b306-d609-4571-89f4-3d7559d8effe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:56.776700 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6b306-d609-4571-89f4-3d7559d8effe admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:56.852390 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1435/2850] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:48:56 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 28 16:48:56.856429 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac620f-3892-4b94-9682-d466b2d02e12 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:56.867581 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac620f-3892-4b94-9682-d466b2d02e12 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:56.872494 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc25dd-8214-4da9-ab79-deb34e179977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:56.873214 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc25dd-8214-4da9-ab79-deb34e179977 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.873498 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc25dd-8214-4da9-ab79-deb34e179977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.873774 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc25dd-8214-4da9-ab79-deb34e179977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.875165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc25dd-8214-4da9-ab79-deb34e179977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:56.876756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc25dd-8214-4da9-ab79-deb34e179977 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:56.887118 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1416/2851] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:48:56.891295 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b306-d609-4571-89f4-3d7559d8effe admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:56.901555 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b306-d609-4571-89f4-3d7559d8effe admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:56.906208 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb57aa6-3caa-4778-9393-0f72e3d51d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:56.906964 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb57aa6-3caa-4778-9393-0f72e3d51d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.907258 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb57aa6-3caa-4778-9393-0f72e3d51d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.907544 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb57aa6-3caa-4778-9393-0f72e3d51d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.908282 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb57aa6-3caa-4778-9393-0f72e3d51d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:56.909890 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb57aa6-3caa-4778-9393-0f72e3d51d1a admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:56.919561 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1436/2852] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:48:56.924101 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc25dd-8214-4da9-ab79-deb34e179977 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:56.934037 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc25dd-8214-4da9-ab79-deb34e179977 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:56.939350 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:56.940229 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:56.940513 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:56.940793 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] PATH_INFO: `/v3/projects/2d5640b9c5144f66bf5ac73c9a9fc797/users/3bdbbf9417224f7b8841da4a4bd68886/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:56.954823 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5640b9c5144f66bf5ac73c9a9fc797, user_id=3bdbbf9417224f7b8841da4a4bd68886, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:56.957509 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:57.034830 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1417/2853] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:48:56 2022] PUT /identity/v3/projects/2d5640b9c5144f66bf5ac73c9a9fc797/users/3bdbbf9417224f7b8841da4a4bd68886/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 28 16:48:57.096087 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614767eb-139d-42d1-bede-4057df14ba7f None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:57.096364 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614767eb-139d-42d1-bede-4057df14ba7f None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:57.096651 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614767eb-139d-42d1-bede-4057df14ba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:57.123246 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-614767eb-139d-42d1-bede-4057df14ba7f None None] MFA Rules not processed for user `3bdbbf9417224f7b8841da4a4bd68886`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:48:57.124469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-614767eb-139d-42d1-bede-4057df14ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:57.186766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1437/2854] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:48:57.197964 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:48:57.199762 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:48:57.254689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e978d-ebc1-4238-9d30-dc3749a5c1a7 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:48:57.258232 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e2d9-5df9-46f7-a343-ed6ba6148db2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63f2a360a89548208edd5fdff1a04e35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:48:57.258908 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e2d9-5df9-46f7-a343-ed6ba6148db2 service glance] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:48:57.259191 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e2d9-5df9-46f7-a343-ed6ba6148db2 service glance] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:48:57.259467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e2d9-5df9-46f7-a343-ed6ba6148db2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:48:57.267570 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e2d9-5df9-46f7-a343-ed6ba6148db2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:48:57.268985 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e2d9-5df9-46f7-a343-ed6ba6148db2 service glance] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:48:57.277775 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1418/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:48:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:49:10.876649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614767eb-139d-42d1-bede-4057df14ba7f None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:10.876649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-614767eb-139d-42d1-bede-4057df14ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:10.942875 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614767eb-139d-42d1-bede-4057df14ba7f None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:10.947433 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:10.948302 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:10.948588 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:10.948867 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] PATH_INFO: `/v3/users/e3cb95e59e354cf3b55407b8873fad0c` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:10.950058 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cb95e59e354cf3b55407b8873fad0c)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:10.952028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:11.110824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cb95e59e354cf3b55407b8873fad0c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.118551 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cb95e59e354cf3b55407b8873fad0c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.119207 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cb95e59e354cf3b55407b8873fad0c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.119824 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cb95e59e354cf3b55407b8873fad0c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.177100 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-f8b85281-4c79-4965-9d00-c1fcd7d5ce19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cb95e59e354cf3b55407b8873fad0c'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.193938 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1438/2856] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:49:10 2022] DELETE /identity/v3/users/e3cb95e59e354cf3b55407b8873fad0c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:49:11.413671 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e2d9-5df9-46f7-a343-ed6ba6148db2 service glance] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:11.424750 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e2d9-5df9-46f7-a343-ed6ba6148db2 service glance] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:11.481803 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:11.482756 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:11.483042 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:11.483344 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] PATH_INFO: `/v3/projects/5c4273160bc44808b1b5ad8dd9fee828` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:11.484555 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4273160bc44808b1b5ad8dd9fee828)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:11.486449 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:11.589148 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4273160bc44808b1b5ad8dd9fee828', 'request_id': 'req-40631cd3-d373-48b1-aa5a-c2414a23055f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.645869 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4273160bc44808b1b5ad8dd9fee828', 'request_id': 'req-40631cd3-d373-48b1-aa5a-c2414a23055f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.652360 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4273160bc44808b1b5ad8dd9fee828', 'request_id': 'req-40631cd3-d373-48b1-aa5a-c2414a23055f'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.666600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] The token cache is being invalidate because project 5c4273160bc44808b1b5ad8dd9fee828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:49:11.666600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.666600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-40631cd3-d373-48b1-aa5a-c2414a23055f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:11.666600 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1419/2857] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:49:11 2022] DELETE /identity/v3/projects/5c4273160bc44808b1b5ad8dd9fee828 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:49:11.670707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9e8d-17e6-41f0-a810-d811063ba502 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:11.671003 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9e8d-17e6-41f0-a810-d811063ba502 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:11.671283 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9e8d-17e6-41f0-a810-d811063ba502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:11.689078 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-91ac9e8d-17e6-41f0-a810-d811063ba502 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:49:11.690268 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-91ac9e8d-17e6-41f0-a810-d811063ba502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:11.747199 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1439/2858] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:49:11.755442 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bddb3-2176-43c7-b171-22d06e402193 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:11.755746 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bddb3-2176-43c7-b171-22d06e402193 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:11.756058 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bddb3-2176-43c7-b171-22d06e402193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:11.774490 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-9e9bddb3-2176-43c7-b171-22d06e402193 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:49:11.775983 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-9e9bddb3-2176-43c7-b171-22d06e402193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:11.783867 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1420/2859] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:49:11.788028 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac9e8d-17e6-41f0-a810-d811063ba502 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:11.797593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac9e8d-17e6-41f0-a810-d811063ba502 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:11.802167 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:11.802839 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:11.803128 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:11.803410 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:11.804140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80049) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 28 16:49:11.804454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:11.806046 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:11.818353 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1440/2860] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Apr 28 16:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 28 16:49:11.822274 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bddb3-2176-43c7-b171-22d06e402193 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:11.831942 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bddb3-2176-43c7-b171-22d06e402193 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:11.836645 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145bf8-0544-4476-9dfc-b72fe5464b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:11.837286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145bf8-0544-4476-9dfc-b72fe5464b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:11.837575 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145bf8-0544-4476-9dfc-b72fe5464b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:11.837854 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145bf8-0544-4476-9dfc-b72fe5464b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:11.838569 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f145bf8-0544-4476-9dfc-b72fe5464b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:11.840461 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f145bf8-0544-4476-9dfc-b72fe5464b71 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:11.933847 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1421/2861] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Apr 28 16:49:11 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:49:11.937917 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:11.948119 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9904991-3bde-41c7-80eb-9ae21f42cdaf admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:12.009190 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e4862-9882-4d47-8bc1-f092ed65f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:12.009859 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e4862-9882-4d47-8bc1-f092ed65f3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:12.010144 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e4862-9882-4d47-8bc1-f092ed65f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:12.010424 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e4862-9882-4d47-8bc1-f092ed65f3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:12.011155 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e4862-9882-4d47-8bc1-f092ed65f3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:12.013073 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e4862-9882-4d47-8bc1-f092ed65f3d0 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:12.091715 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1441/2862] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Apr 28 16:49:11 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 28 16:49:12.096421 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145bf8-0544-4476-9dfc-b72fe5464b71 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:12.107599 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145bf8-0544-4476-9dfc-b72fe5464b71 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:12.112261 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0dad5-d3a5-4a1b-9c5f-40de2f977ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:12.112972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0dad5-d3a5-4a1b-9c5f-40de2f977ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:12.113258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0dad5-d3a5-4a1b-9c5f-40de2f977ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:12.113538 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0dad5-d3a5-4a1b-9c5f-40de2f977ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:12.114293 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0dad5-d3a5-4a1b-9c5f-40de2f977ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:12.115927 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0dad5-d3a5-4a1b-9c5f-40de2f977ea6 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:12.126020 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1422/2863] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:49:12.130224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e4862-9882-4d47-8bc1-f092ed65f3d0 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:12.140449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e4862-9882-4d47-8bc1-f092ed65f3d0 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:12.145692 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59c78a-0310-45f9-9542-ccf724913c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:12.146350 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c78a-0310-45f9-9542-ccf724913c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:12.146707 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c78a-0310-45f9-9542-ccf724913c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:12.147046 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59c78a-0310-45f9-9542-ccf724913c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:12.147821 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59c78a-0310-45f9-9542-ccf724913c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:12.149652 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59c78a-0310-45f9-9542-ccf724913c96 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:12.160416 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1442/2864] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Apr 28 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 28 16:49:12.164572 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0dad5-d3a5-4a1b-9c5f-40de2f977ea6 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:12.175685 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0dad5-d3a5-4a1b-9c5f-40de2f977ea6 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:12.180443 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:12.181322 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:12.181608 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:12.181887 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] PATH_INFO: `/v3/projects/13fa124431bf4fec9b54cd42fd7e703b/users/a690b3c4e7414bd9a8ceb623aa5ec6d5/roles/fbf12d23efc946bdaacd8b4b123dd3fc` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:12.196955 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fa124431bf4fec9b54cd42fd7e703b, user_id=a690b3c4e7414bd9a8ceb623aa5ec6d5, role_id=fbf12d23efc946bdaacd8b4b123dd3fc)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:12.199619 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:12.269254 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1423/2865] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Apr 28 16:49:12 2022] PUT /identity/v3/projects/13fa124431bf4fec9b54cd42fd7e703b/users/a690b3c4e7414bd9a8ceb623aa5ec6d5/roles/fbf12d23efc946bdaacd8b4b123dd3fc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:49:12.334009 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8aff2-df8c-4fbc-91c5-cf6b981951bd None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:12.334413 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8aff2-df8c-4fbc-91c5-cf6b981951bd None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:12.334759 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8aff2-df8c-4fbc-91c5-cf6b981951bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:12.362873 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-f2e8aff2-df8c-4fbc-91c5-cf6b981951bd None None] MFA Rules not processed for user `a690b3c4e7414bd9a8ceb623aa5ec6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:49:12.364134 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f2e8aff2-df8c-4fbc-91c5-cf6b981951bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:12.427141 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1443/2866] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 28 16:49:12.437751 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:12.439489 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:12.494187 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a693a-54b8-40af-95dc-dbf9da598669 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:12.497781 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974955cd-f293-4de6-af31-7477a2e0ef92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a5c2cf875f8451890e04b97b9686956', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:12.498418 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974955cd-f293-4de6-af31-7477a2e0ef92 service cinder] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:12.498732 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974955cd-f293-4de6-af31-7477a2e0ef92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:12.499011 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974955cd-f293-4de6-af31-7477a2e0ef92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:12.507765 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974955cd-f293-4de6-af31-7477a2e0ef92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:12.509182 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974955cd-f293-4de6-af31-7477a2e0ef92 service cinder] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:12.517610 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1424/2867] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:49:34.607740 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8aff2-df8c-4fbc-91c5-cf6b981951bd None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:34.609157 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f2e8aff2-df8c-4fbc-91c5-cf6b981951bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:34.670995 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8aff2-df8c-4fbc-91c5-cf6b981951bd None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:34.676609 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:34.677506 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:34.677836 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:34.678162 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] PATH_INFO: `/v3/users/3bdbbf9417224f7b8841da4a4bd68886` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:34.679369 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdbbf9417224f7b8841da4a4bd68886)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:34.681393 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:34.864223 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdbbf9417224f7b8841da4a4bd68886'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:34.870825 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdbbf9417224f7b8841da4a4bd68886'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:34.871528 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdbbf9417224f7b8841da4a4bd68886'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:34.872130 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdbbf9417224f7b8841da4a4bd68886'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:34.936478 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdbbf9417224f7b8841da4a4bd68886'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:34.954172 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1444/2868] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:49:34 2022] DELETE /identity/v3/users/3bdbbf9417224f7b8841da4a4bd68886 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:49:34.959288 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570b70-2fb8-4044-8ba4-2d1c69340d52 None None] REQUEST_METHOD: `POST` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:34.959828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570b70-2fb8-4044-8ba4-2d1c69340d52 None None] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:34.959934 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2570b70-2fb8-4044-8ba4-2d1c69340d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:34.976591 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.auth.core [None req-c2570b70-2fb8-4044-8ba4-2d1c69340d52 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80048) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:49:34.977796 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c2570b70-2fb8-4044-8ba4-2d1c69340d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:35.033857 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1425/2869] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:49:35.043434 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:35.048887 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:35.101228 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e116be-b78f-4c57-b309-73f2f7c9c79f admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:35.104827 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662a7e0-6fce-4b29-9f62-e1afb2d4a001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:35.105469 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a7e0-6fce-4b29-9f62-e1afb2d4a001 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:35.105754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a7e0-6fce-4b29-9f62-e1afb2d4a001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:35.106035 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662a7e0-6fce-4b29-9f62-e1afb2d4a001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:35.115966 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662a7e0-6fce-4b29-9f62-e1afb2d4a001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:35.116547 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662a7e0-6fce-4b29-9f62-e1afb2d4a001 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:35.126023 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1445/2870] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:49:35.253246 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2570b70-2fb8-4044-8ba4-2d1c69340d52 None None] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:35.254684 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-c2570b70-2fb8-4044-8ba4-2d1c69340d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:35.266915 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2570b70-2fb8-4044-8ba4-2d1c69340d52 None None] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:35.271453 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:35.273834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:35.273834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:35.273834 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] PATH_INFO: `/v3/users/a690b3c4e7414bd9a8ceb623aa5ec6d5` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:35.274139 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a690b3c4e7414bd9a8ceb623aa5ec6d5)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:35.276183 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:35.437587 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a690b3c4e7414bd9a8ceb623aa5ec6d5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:35.438330 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a690b3c4e7414bd9a8ceb623aa5ec6d5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:35.446113 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a690b3c4e7414bd9a8ceb623aa5ec6d5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:35.446859 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a690b3c4e7414bd9a8ceb623aa5ec6d5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:35.554851 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a690b3c4e7414bd9a8ceb623aa5ec6d5'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:35.576583 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1426/2871] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:49:35 2022] DELETE /identity/v3/users/a690b3c4e7414bd9a8ceb623aa5ec6d5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:49:35.581146 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7d21-3dea-4baf-8bf8-80bd163ddac9 None None] REQUEST_METHOD: `POST` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:35.581557 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7d21-3dea-4baf-8bf8-80bd163ddac9 None None] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:35.581841 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b7d21-3dea-4baf-8bf8-80bd163ddac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:35.600541 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.auth.core [None req-b38b7d21-3dea-4baf-8bf8-80bd163ddac9 None None] MFA Rules not processed for user `2df9f80376a24d76bc8b6475e8d5cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80049) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 28 16:49:35.601767 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b38b7d21-3dea-4baf-8bf8-80bd163ddac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:35.660996 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1446/2872] 10.222.0.43 () {58 vars in 957 bytes} [Thu Apr 28 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 28 16:49:35.671163 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:35.672720 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:35.731896 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b4585-0671-4a45-8b6c-47037abd18df admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:35.735480 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:35.736128 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:35.736454 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:35.736727 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:35.746185 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:35.747678 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:35.757384 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1427/2873] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:49:35.781691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b7d21-3dea-4baf-8bf8-80bd163ddac9 None None] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:35.781691 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-b38b7d21-3dea-4baf-8bf8-80bd163ddac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:35.793262 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b7d21-3dea-4baf-8bf8-80bd163ddac9 None None] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:35.798925 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:35.799799 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:35.800085 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:35.800376 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] PATH_INFO: `/v3/projects/2d5640b9c5144f66bf5ac73c9a9fc797` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:35.802325 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5640b9c5144f66bf5ac73c9a9fc797)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:35.805092 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:35.908310 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5640b9c5144f66bf5ac73c9a9fc797', 'request_id': 'req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:35.999933 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5640b9c5144f66bf5ac73c9a9fc797', 'request_id': 'req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.006490 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5640b9c5144f66bf5ac73c9a9fc797', 'request_id': 'req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.017627 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] The token cache is being invalidate because project 2d5640b9c5144f66bf5ac73c9a9fc797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80049) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:49:36.017931 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.018634 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.020308 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1447/2874] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:49:35 2022] DELETE /identity/v3/projects/2d5640b9c5144f66bf5ac73c9a9fc797 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:49:36.127647 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:36.129215 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:36.144252 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c09437-2a0c-40f6-80da-15394bdbb8cb service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:36.205634 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:36.206481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:36.206802 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:36.207081 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] PATH_INFO: `/v3/projects/13fa124431bf4fec9b54cd42fd7e703b` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:36.208328 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fa124431bf4fec9b54cd42fd7e703b)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:36.210856 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:36.325629 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fa124431bf4fec9b54cd42fd7e703b', 'request_id': 'req-8a3b5736-14b8-4461-ac68-90d93cde8e13'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.394061 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fa124431bf4fec9b54cd42fd7e703b', 'request_id': 'req-8a3b5736-14b8-4461-ac68-90d93cde8e13'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.400104 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fa124431bf4fec9b54cd42fd7e703b', 'request_id': 'req-8a3b5736-14b8-4461-ac68-90d93cde8e13'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.411072 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] The token cache is being invalidate because project 13fa124431bf4fec9b54cd42fd7e703b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:49:36.412387 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.412698 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:49:36.414699 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1428/2875] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:49:36 2022] DELETE /identity/v3/projects/13fa124431bf4fec9b54cd42fd7e703b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:49:42.296090 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:42.297716 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:42.359094 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb8656-e853-4cfb-891c-4a57ed3b4b61 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:42.406089 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:42.406789 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:42.407061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:42.407339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:42.409150 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:42.424757 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:42.426322 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:42.436749 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1448/2876] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:49:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 28 16:49:42.690683 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:42.692147 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:42.704529 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5736-14b8-4461-ac68-90d93cde8e13 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:42.708376 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:42.709824 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:42.710137 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:42.710416 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:42.712286 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:42.791022 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:42.792534 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:42.804211 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1429/2877] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:49:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:49:43.980921 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:43.989593 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ad2b8-da35-4479-8310-358166adde6f service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:43.994233 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:43.994910 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:43.995200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:43.995480 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:43.997244 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:44.011782 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:44.013229 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:44.025030 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1449/2878] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:49:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:49:47.168735 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:47.170504 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:47.184920 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada79b8-34cc-466a-92e3-5fb6d135dc3e service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:47.190607 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:47.191258 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:47.191548 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:47.191828 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:47.193701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:47.206317 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:47.209696 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:47.218367 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1430/2879] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:49:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:49:49.646021 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:49:49.647465 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:49.662515 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e841fb-0a62-441a-8016-41a3744cd1d0 service neutron] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:49:49.668084 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b28dcc32b984429939b95e436b4d41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:49:49.668783 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:49:49.669037 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:49:49.669315 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:49:49.671735 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:49:49.684633 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:49:49.686224 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:49:49.697814 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1450/2880] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:49:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:50:01.528754 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:50:01.537972 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31553458-85e4-4ba2-b79b-4539f11c34da service nova] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:50:01.541996 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebf1f55dbef94868aaac6d39ed70690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:50:01.542701 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] REQUEST_METHOD: `GET` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:50:01.542984 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:50:01.543260 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:50:01.544999 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:50:01.607172 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:50:01.608631 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:50:01.618065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1431/2881] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 28 16:50:08.931255 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:50:08.941449 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:50:08.990754 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46424911-2761-4a6c-8ec2-9de001fef929 service nova] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:50:08.996454 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:50:08.997332 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:50:08.997646 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:50:08.997981 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] PATH_INFO: `/v3/users/3b3b7cf50b844d94948110080a7eaed4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:50:08.999200 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3b7cf50b844d94948110080a7eaed4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:50:09.002403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:50:09.201597 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3b7cf50b844d94948110080a7eaed4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.208567 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3b7cf50b844d94948110080a7eaed4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.209279 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3b7cf50b844d94948110080a7eaed4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.209853 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3b7cf50b844d94948110080a7eaed4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.273568 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3b7cf50b844d94948110080a7eaed4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.292635 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1451/2882] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:50:08 2022] DELETE /identity/v3/users/3b3b7cf50b844d94948110080a7eaed4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:50:09.544309 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:50:09.579285 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2b031-1530-4ac9-b3be-8b6d598d6390 service neutron] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:50:09.633327 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:50:09.634193 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:50:09.634481 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:50:09.634794 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] PATH_INFO: `/v3/projects/06de2697b6a24554aacc026dbd32cd46` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:50:09.636595 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06de2697b6a24554aacc026dbd32cd46)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:50:09.638602 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:50:09.726479 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06de2697b6a24554aacc026dbd32cd46', 'request_id': 'req-5ca39220-fd0a-4271-8168-8eed88e42ca3'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.775656 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06de2697b6a24554aacc026dbd32cd46', 'request_id': 'req-5ca39220-fd0a-4271-8168-8eed88e42ca3'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.781782 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06de2697b6a24554aacc026dbd32cd46', 'request_id': 'req-5ca39220-fd0a-4271-8168-8eed88e42ca3'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.795689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] The token cache is being invalidate because project 06de2697b6a24554aacc026dbd32cd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:50:09.795689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.795689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:09.795689 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1432/2883] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:50:09 2022] DELETE /identity/v3/projects/06de2697b6a24554aacc026dbd32cd46 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:50:09.799649 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:50:09.801061 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:50:09.814095 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66736d8-d63e-4ced-86df-42fbc97cc5fd admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:50:09.868834 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:50:09.869702 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:50:09.869986 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:50:09.870261 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] PATH_INFO: `/v3/users/90e076c5ccb54342b84041a1adbf91a4` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:50:09.871479 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e076c5ccb54342b84041a1adbf91a4)` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:50:09.873403 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:50:10.035604 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e076c5ccb54342b84041a1adbf91a4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.042375 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e076c5ccb54342b84041a1adbf91a4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.043145 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e076c5ccb54342b84041a1adbf91a4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.043766 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e076c5ccb54342b84041a1adbf91a4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.107511 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.notifications [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e076c5ccb54342b84041a1adbf91a4'} {{(pid=80049) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.124531 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1452/2884] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Apr 28 16:50:09 2022] DELETE /identity/v3/users/90e076c5ccb54342b84041a1adbf91a4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:50:10.337467 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] Authenticating user token {{(pid=80048) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:50:10.339102 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.fernet_utils [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80048) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:50:10.352111 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39220-fd0a-4271-8168-8eed88e42ca3 admin admin] Validating token access rules against request {{(pid=80048) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:50:10.409719 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2df9f80376a24d76bc8b6475e8d5cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0143687fa93942b783a5884094e78824', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80048) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:50:10.410764 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:50:10.410998 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:50:10.411165 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] PATH_INFO: `/v3/projects/67872c73a9e74f55803e5fe1e4763b32` {{(pid=80048) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:50:10.412340 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67872c73a9e74f55803e5fe1e4763b32)` {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:50:10.414223 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] RBAC: Authorization granted {{(pid=80048) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:50:10.496112 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67872c73a9e74f55803e5fe1e4763b32', 'request_id': 'req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.582065 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67872c73a9e74f55803e5fe1e4763b32', 'request_id': 'req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.587805 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67872c73a9e74f55803e5fe1e4763b32', 'request_id': 'req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47'} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.598597 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] The token cache is being invalidate because project 67872c73a9e74f55803e5fe1e4763b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80048) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 28 16:50:10.598891 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.599540 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: DEBUG keystone.notifications [None req-68921ebe-c921-4d1f-b1f5-bc1e301b5c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80048) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 28 16:50:10.601130 dv-cinder-839760-2-iscsi devstack@keystone.service[80048]: [pid: 80048|app: 0|req: 1433/2885] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Apr 28 16:50:10 2022] DELETE /identity/v3/projects/67872c73a9e74f55803e5fe1e4763b32 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 28 16:51:49.500002 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] Authenticating user token {{(pid=80049) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 28 16:51:49.501432 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:51:49.620689 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ac5c-5626-411c-8949-0e9b53d424c2 admin admin] Validating token access rules against request {{(pid=80049) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 28 16:51:49.677209 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139fadb-3244-482f-9aab-3080d39a46a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded012db549b45669a4ffcdd988b55ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '537376d891e2442ba8b85062f564cbb5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80049) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 28 16:51:49.677856 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139fadb-3244-482f-9aab-3080d39a46a5 service placement] REQUEST_METHOD: `GET` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 28 16:51:49.678140 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139fadb-3244-482f-9aab-3080d39a46a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 28 16:51:49.678419 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139fadb-3244-482f-9aab-3080d39a46a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80049) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 28 16:51:49.680204 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.fernet_utils [None req-f139fadb-3244-482f-9aab-3080d39a46a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80049) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 28 16:51:49.691768 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139fadb-3244-482f-9aab-3080d39a46a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 28 16:51:49.693339 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139fadb-3244-482f-9aab-3080d39a46a5 service placement] RBAC: Authorization granted {{(pid=80049) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 28 16:51:49.703772 dv-cinder-839760-2-iscsi devstack@keystone.service[80049]: [pid: 80049|app: 0|req: 1453/2886] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Apr 28 16:51:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)